Sat Jun 29 22:17:45.427 [conn173728] serverStatus was very slow: { after basic: 0, after asserts: 0, after backgroundFlushing: 0, after connections: 0, after cursors: 0, after dur: 0, after extra_info: 0, after globalLock: 0, after indexCounters: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after recordStats: 1081, after repl: 1081, at end: 1081 } Sat Jun 29 22:17:45.427 [conn173728] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 keyUpdates:0 locks(micros) r:129 reslen:4982 1682ms Sat Jun 29 22:21:08.667 [conn173694] build index SteelCityBuzzStats.tmp.mr.Posts_11002_inc { 0: 1 } Sat Jun 29 22:21:08.682 [conn173694] build index done. scanned 0 total records. 0.004 secs Sat Jun 29 22:21:08.682 [conn173694] build index SteelCityBuzzStats.tmp.mr.Posts_11002 { _id: 1 } Sat Jun 29 22:21:08.713 [conn173694] build index done. scanned 0 total records. 0.037 secs Sat Jun 29 22:21:08.713 [conn173744] build index SteelCityBuzzStats.tmp.mr.UserPings_11001_inc { 0: 1 } Sat Jun 29 22:21:08.729 [conn173744] build index done. scanned 0 total records. 0.008 secs Sat Jun 29 22:21:08.729 [conn173744] build index SteelCityBuzzStats.tmp.mr.UserPings_11001 { _id: 1 } Sat Jun 29 22:21:08.729 [conn173744] build index done. scanned 0 total records. 0 secs Sat Jun 29 22:21:08.729 [conn173694] build index SteelCityBuzzStats.tmp.mr.Replies_11003_inc { 0: 1 } Sat Jun 29 22:21:08.729 [conn173694] build index done. scanned 0 total records. 0 secs Sat Jun 29 22:21:08.729 [conn173694] build index SteelCityBuzzStats.tmp.mr.Replies_11003 { _id: 1 } Sat Jun 29 22:21:08.729 [conn173694] build index done. scanned 0 total records. 0 secs Sat Jun 29 22:21:19.337 [conn173694] update SteelCityBuzz.PushNotificationSubscriptions query: { _id: ObjectId('5096eae20b0f471160b2da98') } update: { $set: { CheckedForNewNotificationsAt: new Date(1372558827000) } } idhack:1 nupdated:1 fastmod:1 keyUpdates:0 locks(micros) w:41 3725ms Sat Jun 29 22:21:19.337 [conn173710] update SteelCityBuzz.PushNotificationSubscriptions query: { _id: ObjectId('505bbd8d0b0f470cf4e3df74') } update: { _id: ObjectId('505bbd8d0b0f470cf4e3df74'), DeviceOS: 1, DeviceToken: "251b56734139194c6dbd7e3556c8837a20f243c6e76f70ea0513336f5459bfc8", ExitedAppAt: new Date(1372558851000), CheckedForNewNotificationsAt: new Date(1372558851000), MissedPostCount: 0 } idhack:1 nupdated:1 upsert:1 keyUpdates:0 locks(micros) w:6093125 3046ms Sat Jun 29 22:21:19.337 [conn53] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1370368734000|1 } } cursorid:772550127339337 ntoreturn:0 keyUpdates:0 locks(micros) r:45 nreturned:1 reslen:37 3711ms Sat Jun 29 22:21:19.337 [conn52] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1370368731000|7 } } cursorid:769195095652851 ntoreturn:0 keyUpdates:0 locks(micros) r:47 nreturned:1 reslen:318 3711ms Sat Jun 29 22:21:59.227 [DataFileSync] flushing mmaps took 18018ms for 43 files Sat Jun 29 22:21:59.398 [conn173662] *** unhandled exception 0xC0000006 at 0x000000013FD302D4, terminating Sat Jun 29 22:21:59.398 [conn173662] *** stack trace for unhandled exception: Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\pagefault.cpp(49) mongo::PageFaultException::touch+0xe4 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\ops\query.cpp(1050) `mongo::runQuery'::`1'::catch$0+0x19 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe f:\dd\vctools\crt_bld\SELF_64_amd64\crt\prebuild\eh\amd64\handlers.asm(44) _CallSettingFrame+0x20 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe f:\dd\vctools\crt_bld\self_64_amd64\crt\prebuild\eh\frame.cpp(1337) __CxxCallCatchBlock+0xeb Sat Jun 29 22:22:14.577 [conn173662] ntdll.dll RtlRestoreContext+0x2e2 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\ops\query.cpp(1047) mongo::runQuery+0x1381 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\instance.cpp(262) mongo::receivedQuery+0x35d Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\instance.cpp(401) mongo::assembleResponse+0x2f0 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\db\db.cpp(194) mongo::MyMessageHandler::process+0xfa Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\mongo\util\net\message_server_port.cpp(207) mongo::PortMessageServer::handleIncomingMsg+0x56a Sat Jun 29 22:22:14.577 [conn173662] mongod.exe ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(180) boost::`anonymous namespace'::thread_start_function+0x21 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314) _callthreadstartex+0x17 Sat Jun 29 22:22:14.577 [conn173662] mongod.exe f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292) _threadstartex+0x7f Sat Jun 29 22:22:14.577 [conn173662] kernel32.dll BaseThreadInitThunk+0xd Sat Jun 29 22:22:14.655 [conn173662] writing minidump diagnostic file mongo.dmp Sat Jun 29 22:22:16.013 [conn173662] *** immediate exit due to unhandled exception ***** SERVER RESTARTED ***** Sat Jun 29 22:38:25.940 Trying to start Windows service 'MongoDB' Sat Jun 29 22:38:25.955 Service running Sat Jun 29 22:38:25.955 [initandlisten] MongoDB starting : pid=2728 port=27017 dbpath=D:\mongodb\data 64-bit host=LFDB01 Sat Jun 29 22:38:25.955 [initandlisten] db version v2.4.4 Sat Jun 29 22:38:25.955 [initandlisten] git version: 4ec1fb96702c9d4c57b1e06dd34eb73a16e407d2 Sat Jun 29 22:38:25.955 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 Sat Jun 29 22:38:25.955 [initandlisten] allocator: system Sat Jun 29 22:38:25.955 [initandlisten] options: { config: "D:\mongodb\mongod.cfg", dbpath: "D:\mongodb\data", directoryperdb: "true", journal: "true", logappend: "true", logpath: "D:\mongodb\log\mongodlog.txt", noauth: "true", pidfilepath: "D:\mongodb\mongod.pid", quiet: "true", replSet: "SteelCityBuzz", rest: "true", service: true } Sat Jun 29 22:38:25.986 [initandlisten] journal dir=D:\mongodb\data\journal Sat Jun 29 22:38:25.986 [initandlisten] recover begin Sat Jun 29 22:38:25.986 [initandlisten] recover lsn: 1404156838 Sat Jun 29 22:38:25.986 [initandlisten] recover D:\mongodb\data\journal\j._119 Sat Jun 29 22:38:26.018 [initandlisten] recover skipping application of section seq:1359872745 < lsn:1404156838 Sat Jun 29 22:38:26.267 [initandlisten] recover skipping application of section seq:1359911209 < lsn:1404156838 Sat Jun 29 22:38:26.532 [initandlisten] recover skipping application of section seq:1359949686 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1359988161 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1360026635 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1360065109 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1360103583 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1360142057 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section seq:1360180531 < lsn:1404156838 Sat Jun 29 22:38:26.579 [initandlisten] recover skipping application of section more... Sat Jun 29 22:38:36.423 [initandlisten] recover D:\mongodb\data\journal\j._120 Sat Jun 29 22:38:49.012 [initandlisten] recover cleaning up Sat Jun 29 22:38:49.012 [initandlisten] removeJournalFiles Sat Jun 29 22:38:49.106 [initandlisten] recover done Sat Jun 29 22:38:50.479 [initandlisten] waiting for connections on port 27017 Sat Jun 29 22:38:50.479 [websvr] admin web console waiting for connections on port 28017 Sat Jun 29 22:38:56.516 [rsStart] replSet I am lfdb01.localnet:27017 Sat Jun 29 22:39:02.522 [rsStart] replSet STARTUP2 Sat Jun 29 22:39:03.567 [rsSync] replSet SECONDARY Sat Jun 29 22:39:04.534 [rsHealthPoll] replSet member lfweb01.localnet:27017 is up Sat Jun 29 22:39:04.534 [rsHealthPoll] replSet member lfweb01.localnet:27017 is now in state ARBITER Sat Jun 29 22:39:08.528 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:39:14.534 [MultiCommandJob] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:39:20.571 [rsMgr] not electing self, lfweb01.localnet:27017 would veto with 'I don't think lfdb01.localnet:27017 is electable' Sat Jun 29 22:39:26.577 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:39:32.599 [rsHealthPoll] replSet info lfdb02.localnet:27017 is down (or slow to respond): Sat Jun 29 22:39:32.599 [rsHealthPoll] replSet member lfdb02.localnet:27017 is now in state DOWN Sat Jun 29 22:39:38.590 [MultiCommandJob] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:39:44.596 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes Sat Jun 29 22:39:50.602 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:39:56.608 [MultiCommandJob] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:02.614 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes Sat Jun 29 22:40:08.620 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:20.632 [MultiCommandJob] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:26.638 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes Sat Jun 29 22:40:32.660 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:38.666 [MultiCommandJob] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:44.672 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes Sat Jun 29 22:40:44.672 [rsMgr] replSet info electSelf 0 Sat Jun 29 22:40:44.937 [rsMgr] replSet PRIMARY Sat Jun 29 22:40:50.678 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:40:53.720 [conn31] query SteelCityBuzz.UserPings query: { PingedDuring: new Date(1372557600000), UserId: ObjectId('518eb2be0b0f470f043274ed'), Platform: 1 } ntoreturn:1 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:1787125 nreturned:1 reslen:113 1787ms Sat Jun 29 22:40:53.720 [conn28] query SteelCityBuzz.UserPings query: { PingedDuring: new Date(1372557600000), UserId: ObjectId('517c58bc0b0f470a58883646'), Platform: 1 } ntoreturn:1 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:1787489 nreturned:0 reslen:20 1787ms Sat Jun 29 22:40:53.720 [conn29] query SteelCityBuzz.UserPings query: { PingedDuring: new Date(1372557600000), UserId: ObjectId('518eb2be0b0f470f043274ed'), Platform: 1 } ntoreturn:1 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:1787432 nreturned:1 reslen:113 1787ms Sat Jun 29 22:40:53.751 [conn30] query SteelCityBuzz.Users query: { ScreenNameUpperCase: "T-ROY" } ntoreturn:0 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:1808873 nreturned:1 reslen:728 1808ms Sat Jun 29 22:40:53.751 [conn32] query SteelCityBuzz.Users query: { ScreenNameUpperCase: "PUCKHEAD" } ntoreturn:0 ntoskip:0 nscanned:2 keyUpdates:0 locks(micros) r:1817458 nreturned:2 reslen:1227 1817ms Sat Jun 29 22:40:53.783 [conn7] query SteelCityBuzz.Users query: { ScreenNameUpperCase: "FLOYD93" } ntoreturn:0 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:504 nreturned:1 reslen:558 1845ms Sat Jun 29 22:40:53.798 [conn33] query SteelCityBuzz.Users query: { _id: ObjectId('5160c7960b0f470eb8ca045d') } ntoreturn:1 idhack:1 keyUpdates:0 locks(micros) r:65 reslen:750 1863ms Sat Jun 29 22:40:53.829 [conn1] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:3893995 3893ms Sat Jun 29 22:40:53.892 [conn9] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:106214 3947ms Sat Jun 29 22:40:53.892 [conn28] insert SteelCityBuzz.UserPings ninserted:1 keyUpdates:0 locks(micros) w:42132 129ms Sat Jun 29 22:40:53.892 [conn38] query SteelCityBuzz.Users query: { _id: ObjectId('506ef9fc0b0f4703d0ed9681') } ntoreturn:1 idhack:1 keyUpdates:0 locks(micros) r:17452 reslen:65 105ms Sat Jun 29 22:40:53.892 [conn36] query SteelCityBuzz.Users query: { _id: ObjectId('4f356da537a5880c807307ce') } ntoreturn:1 idhack:1 keyUpdates:0 locks(micros) r:17472 reslen:65 106ms Sat Jun 29 22:40:53.923 [conn32] query SteelCityBuzz.UserRelationships query: { ParentUserId: ObjectId('4eacb80337a5880374407615'), Relationship: 1 } ntoreturn:250 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:32955 nreturned:0 reslen:20 138ms Sat Jun 29 22:40:53.923 [conn42] query SteelCityBuzz.UserRelationships query: { ParentUserId: ObjectId('5090714f0b0f470dbc759ed8'), Relationship: 1 } ntoreturn:250 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:42702 nreturned:0 reslen:20 126ms Sat Jun 29 22:40:53.939 [conn35] query SteelCityBuzz.PostLikes query: { $query: { PostedById: ObjectId('501547d4fe2a050d0cc6532e'), LikedAtTick: { $gt: 635081553685528307 } }, $orderby: { LikedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:58489 nreturned:0 reslen:20 142ms Sat Jun 29 22:40:53.939 [conn41] query SteelCityBuzz.Users query: { ScreenNameUpperCase: "BLITZBURGH31" } ntoreturn:0 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:507 nreturned:1 reslen:731 188ms Sat Jun 29 22:40:54.032 [conn9] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:222347 111ms Sat Jun 29 22:40:54.048 [conn34] remove SteelCityBuzz.PushNotificationSubscriptions query: { _id: ObjectId('517c58bc0b0f470a58883646') } ndeleted:1 keyUpdates:0 numYields: 1 locks(micros) w:67022 290ms Sat Jun 29 22:40:54.048 [conn46] query SteelCityBuzz.LeagueScores query: { _id: 2 } ntoreturn:0 idhack:1 keyUpdates:0 locks(micros) r:148 reslen:121 160ms Sat Jun 29 22:40:54.048 [conn28] query SteelCityBuzz.PostLikes query: { $query: { PostedById: ObjectId('517c58bc0b0f470a58883646'), LikedAtTick: { $gt: 635080596139622467 } }, $orderby: { LikedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:651 nreturned:0 reslen:20 101ms Sat Jun 29 22:40:54.110 [conn3] update SteelCityBuzz.ScheduledTasks query: { _id: ObjectId('4f86ed428b4426254c3dfb9f') } update: { _id: ObjectId('4f86ed428b4426254c3dfb9f'), Name: "Download Latest Scores", TypeName: "LaunchFarm.ScheduledTaskRunner.Tasks.DownloadLatestGameInfo, LaunchFarm.ScheduledTaskRunner, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null", Enabled: true, Schedule: { DateRanges: {}, Months: {}, DaysOfMonth: {}, DaysOfWeek: {}, Times: {}, TimeIntervals: [ { Interval: 300000000, StartTime: null, EndTime: null } ] }, LastRunDate: new Date(1372560005000), NextRunDate: new Date(1372560030000) } idhack:1 nupdated:1 keyUpdates:0 locks(micros) w:226 164ms Sat Jun 29 22:40:54.297 [conn9] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:204353 102ms Sat Jun 29 22:40:54.297 [conn39] query SteelCityBuzz.Users query: { _id: ObjectId('505bbd8d0b0f470cf4e3df74') } ntoreturn:1 idhack:1 keyUpdates:0 locks(micros) r:131 reslen:695 109ms Sat Jun 29 22:40:54.297 [conn7] query SteelCityBuzz.Posts query: { $query: { LastReplyPostedAtTick: { $gt: 635081517610000000 } }, $orderby: { LastReplyPostedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:53 keyUpdates:0 locks(micros) r:2877 nreturned:53 reslen:3677 103ms Sat Jun 29 22:40:54.391 [conn31] query SteelCityBuzz.UserAvatars query: { $query: { UploadedAtTick: { $gt: 635079840290897960 } }, $orderby: { UploadedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:20 keyUpdates:0 numYields: 2 locks(micros) r:197458 nreturned:20 reslen:940 281ms Sat Jun 29 22:40:54.391 [conn30] query SteelCityBuzz.UserAvatars query: { $query: { UploadedAtTick: { $gt: 635079840291209961 } }, $orderby: { UploadedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:20 keyUpdates:0 numYields: 2 locks(micros) r:196810 nreturned:20 reslen:940 202ms Sat Jun 29 22:40:54.469 [conn34] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 3 locks(micros) r:156209 nreturned:0 reslen:20 178ms Sat Jun 29 22:40:54.469 [conn29] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 3 locks(micros) r:155708 nreturned:0 reslen:20 179ms Sat Jun 29 22:40:54.469 [conn35] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 3 locks(micros) r:155547 nreturned:0 reslen:20 179ms Sat Jun 29 22:40:54.469 [conn36] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 3 locks(micros) r:155620 nreturned:0 reslen:20 179ms Sat Jun 29 22:40:54.469 [conn28] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 3 locks(micros) r:155896 nreturned:0 reslen:20 179ms Sat Jun 29 22:40:54.531 [conn48] query SteelCityBuzz.EmailQueue query: { $query: { SentDate: { $type: 10 } }, $orderby: { CreateDate: 1 } } ntoreturn:250 ntoskip:0 nscanned:2 keyUpdates:0 locks(micros) r:51252 nreturned:2 reslen:501 137ms Sat Jun 29 22:40:54.531 [conn33] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:622 keyUpdates:0 numYields: 4 locks(micros) r:155096 nreturned:0 reslen:20 230ms Sat Jun 29 22:40:54.547 [conn3] *** unhandled exception (access violation) at 0x0000000140275C2E, terminating Sat Jun 29 22:40:54.547 [conn3] *** access violation was a read from 0x0000000000000000 Sat Jun 29 22:40:54.547 [conn3] *** stack trace for unhandled exception: Sat Jun 29 22:40:54.547 [conn1] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:152559 152ms Sat Jun 29 22:40:54.609 [conn44] query SteelCityBuzz.UserRelationships query: { ParentUserId: ObjectId('505bbd8d0b0f470cf4e3df74'), Relationship: 2 } ntoreturn:250 ntoskip:0 nscanned:95 keyUpdates:0 locks(micros) r:823 nreturned:95 reslen:2870 134ms Sat Jun 29 22:40:54.687 [conn7] query SteelCityBuzz.Replies query: { $query: { LastLikedAtTick: { $gt: 635081517420000000 } }, $orderby: { LastLikedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:125 keyUpdates:0 numYields: 4 locks(micros) r:360579 nreturned:125 reslen:7770 379ms Sat Jun 29 22:40:54.687 [conn49] query SteelCityBuzz.AdminMessageQueue query: { $query: { SentDate: { $type: 10 } }, $orderby: { CreateDate: 1 } } ntoreturn:250 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:43338 nreturned:0 reslen:20 157ms Sat Jun 29 22:40:54.687 [conn41] query SteelCityBuzz.UserRelationships query: { ChildUserId: ObjectId('5107b9670b0f470a24a5ef6c'), Relationship: 2 } cursorid:342060584212244 ntoreturn:250 ntoskip:0 nscanned:251 keyUpdates:0 numYields: 2 locks(micros) r:196796 nreturned:250 reslen:7770 209ms Sat Jun 29 22:40:54.765 [conn46] build index SteelCityBuzzStats.tmp.mr.Posts_0_inc { 0: 1 } Sat Jun 29 22:40:54.781 [conn46] build index done. scanned 0 total records. 0.012 secs Sat Jun 29 22:40:54.812 [conn9] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:240072 120ms Sat Jun 29 22:40:54.812 [conn46] build index SteelCityBuzzStats.tmp.mr.Posts_0 { _id: 1 } Sat Jun 29 22:40:54.812 [conn45] query SteelCityBuzz.UserRelationships query: { ParentUserId: ObjectId('5074cc2c0b0f470fc848a8cf'), Relationship: 2 } cursorid:342412448965142 ntoreturn:250 ntoskip:0 nscanned:251 keyUpdates:0 numYields: 1 locks(micros) r:2016 nreturned:250 reslen:7520 135ms Sat Jun 29 22:40:58.962 [conn46] build index done. scanned 0 total records. 4.148 secs Sat Jun 29 22:40:59.009 [conn30] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('518eb2be0b0f470f043274ed'), PostedAtTick: { $gt: 635081557803935541 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:4197091 nreturned:0 reslen:20 4197ms Sat Jun 29 22:40:59.024 [conn34] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('506ef9fc0b0f4703d0ed9681'), PostedAtTick: { $gt: 635080609164241343 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:4207227 nreturned:0 reslen:20 4207ms Sat Jun 29 22:40:59.040 [conn44] query SteelCityBuzz.UserRelationships query: { ChildUserId: ObjectId('505bbd8d0b0f470cf4e3df74'), Relationship: 2 } ntoreturn:250 ntoskip:0 nscanned:175 keyUpdates:0 numYields: 2 locks(micros) r:8443598 nreturned:175 reslen:5445 4356ms Sat Jun 29 22:40:59.040 [conn29] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('506ef9fc0b0f4703d0ed9681'), PostedAtTick: { $gt: 635080609164241343 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:563 nreturned:0 reslen:20 4221ms Sat Jun 29 22:40:59.040 [conn35] query SteelCityBuzz.UserRelationships query: { ParentUserId: ObjectId('517c58bc0b0f470a58883646'), Relationship: 1 } ntoreturn:250 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:421 nreturned:0 reslen:20 4221ms Sat Jun 29 22:40:59.040 [conn32] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('501547d4fe2a050d0cc6532e'), PostedAtTick: { $gt: 635080350816711580 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:345 nreturned:0 reslen:20 4221ms Sat Jun 29 22:40:59.040 [conn36] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('501547d4fe2a050d0cc6532e'), PostedAtTick: { $gt: 635080350816711580 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:473 nreturned:0 reslen:20 4221ms Sat Jun 29 22:40:59.040 [conn37] query SteelCityBuzz.UserRelationships query: { ChildUserId: ObjectId('4eacb80337a5880374407615'), Relationship: 2 } cursorid:354077990935949 ntoreturn:250 ntoskip:0 nscanned:251 keyUpdates:0 numYields: 2 locks(micros) r:236982 nreturned:250 reslen:7770 4433ms Sat Jun 29 22:40:59.102 [conn27] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:8509774 4254ms Sat Jun 29 22:40:59.102 [conn39] query SteelCityBuzz.PostThreadUpdatesForUsers query: { ForUserId: ObjectId('518eb2be0b0f470f043274ed'), PostedAtTick: { $gt: 635081557803935541 } } ntoreturn:500 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:815 nreturned:0 reslen:20 4276ms Sat Jun 29 22:40:59.243 [conn9] insert elmah.Elmah ninserted:1 keyUpdates:0 locks(micros) w:127343 127ms Sat Jun 29 22:40:59.336 [conn46] command SteelCityBuzz.$cmd command: { mapreduce: "Posts", map: function map() { var isCelebrity = this.PostedByType !== 0 && this...., reduce: function reduce(key, values) { var result = { Posters: [], ..., out: { reduce: "PostersPerHour", db: "SteelCityBuzzStats" }, query: { PostedAtTick: { $lt: 635081544000000000, $gte: 635081544000000000 } }, finalize: function finalize(key, value) { var nonCelebrityPostersCount = 0, ... } ntoreturn:1 keyUpdates:0 numYields: 1 locks(micros) W:42 r:811 w:4276573 reslen:182 5212ms Sat Jun 29 22:40:59.399 [conn39] query SteelCityBuzz.PostLikes query: { $query: { PostedById: ObjectId('518999d20b0f4713006d4a5d'), LikedAtTick: { $gt: 635081568341286049 } }, $orderby: { LikedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:930 nreturned:0 reslen:20 241ms Sat Jun 29 22:40:59.399 [conn59] query SteelCityBuzz.PostLikes query: { $query: { PostedById: ObjectId('4f7ddf1ffe2a050af0ff5e42'), LikedAtTick: { $gt: 635081553512992004 } }, $orderby: { LikedAtTick: -1 } } ntoreturn:1000 ntoskip:0 nscanned:0 keyUpdates:0 locks(micros) r:513 nreturned:0 reslen:20 164ms Sat Jun 29 22:40:59.445 [conn49] update SteelCityBuzz.EmailQueue query: { _id: ObjectId('51cf95fe0b0f470e14f79e9c') } update: { $set: { SentDate: new Date(1372560006000) } } nscanned:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:14729 280ms Sat Jun 29 22:40:59.445 [conn35] query SteelCityBuzz.Posts query: { $query: { PostedAtTick: { $gt: 635081430675256251 }, PostedByCelebrity: true }, $orderby: { PostedAtTick: -1 } } ntoreturn:100 ntoskip:0 nscanned:311 keyUpdates:0 numYields: 2 locks(micros) r:3161 nreturned:0 reslen:20 280ms Sat Jun 29 22:40:59.508 [conn14] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 keyUpdates:0 locks(micros) r:106 reslen:4644 266ms Sat Jun 29 22:41:04.703 [rsHealthPoll] couldn't connect to lfdb02.localnet:27017: couldn't connect to server lfdb02.localnet:27017 Sat Jun 29 22:41:04.703 [rsHealthPoll] replSet member lfdb02.localnet:27017 is up Sat Jun 29 22:41:04.703 [rsHealthPoll] replSet member lfdb02.localnet:27017 is now in state SECONDARY Sat Jun 29 22:41:33.704 [conn23] *** unhandled exception 0xC0000006 at 0x00000001400C02D4, terminating Sat Jun 29 22:41:33.704 [conn23] *** stack trace for unhandled exception: Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\scripting\engine.cpp(174) mongo::Scope::loadStored+0x10e Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\scripting\engine.cpp(423) mongo::ScriptEngine::getPooledScope+0x1e5 Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\commands\mr.cpp(625) mongo::mr::State::init+0x6c Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\commands\mr.cpp(1166) mongo::mr::MapReduceCommand::run+0x824 Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\dbcommands.cpp(1908) mongo::_execCommand+0x5e Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\dbcommands.cpp(2017) mongo::Command::execCommand+0x936 Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\dbcommands.cpp(2109) mongo::_runCommands+0x3fd Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\ops\query.cpp(46) mongo::runCommands+0x46 Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\ops\query.cpp(952) mongo::runQuery+0x43f Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\instance.cpp(262) mongo::receivedQuery+0x35d Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\instance.cpp(401) mongo::assembleResponse+0x2f0 Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\db\db.cpp(194) mongo::MyMessageHandler::process+0xfa Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\mongo\util\net\message_server_port.cpp(207) mongo::PortMessageServer::handleIncomingMsg+0x56a Sat Jun 29 22:41:48.415 [conn3] mongod.exe ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(180) boost::`anonymous namespace'::thread_start_function+0x21 Sat Jun 29 22:41:48.415 [conn3] mongod.exe f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314) _callthreadstartex+0x17 Sat Jun 29 22:41:48.415 [conn3] mongod.exe f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292) _threadstartex+0x7f Sat Jun 29 22:41:48.415 [conn3] kernel32.dll BaseThreadInitThunk+0xd Sat Jun 29 22:41:48.415 [conn3] writing minidump diagnostic file mongo.dmp Sat Jun 29 22:41:49.101 [conn3] *** immediate exit due to unhandled exception ***** SERVER RESTARTED ***** Sat Jun 29 22:56:46.690 Trying to start Windows service 'MongoDB' Sat Jun 29 22:56:46.690 Service running Sat Jun 29 22:56:46.690 [initandlisten] MongoDB starting : pid=2236 port=27017 dbpath=D:\mongodb\data 64-bit host=LFDB01 Sat Jun 29 22:56:46.690 [initandlisten] db version v2.4.4 Sat Jun 29 22:56:46.690 [initandlisten] git version: 4ec1fb96702c9d4c57b1e06dd34eb73a16e407d2 Sat Jun 29 22:56:46.690 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 Sat Jun 29 22:56:46.690 [initandlisten] allocator: system Sat Jun 29 22:56:46.690 [initandlisten] options: { config: "D:\mongodb\mongod.cfg", dbpath: "D:\mongodb\data", directoryperdb: "true", journal: "true", logappend: "true", logpath: "D:\mongodb\log\mongodlog.txt", noauth: "true", pidfilepath: "D:\mongodb\mongod.pid", quiet: "true", replSet: "SteelCityBuzz", rest: "true", service: true } Sat Jun 29 22:56:46.690 [initandlisten] journal dir=D:\mongodb\data\journal Sat Jun 29 22:56:46.690 [initandlisten] recover begin Sat Jun 29 22:56:46.690 [initandlisten] recover lsn: 61228 Sat Jun 29 22:56:46.690 [initandlisten] recover D:\mongodb\data\journal\j._0 Sat Jun 29 22:56:46.705 [initandlisten] recover skipping application of section seq:0 < lsn:61228 Sat Jun 29 22:56:46.861 [initandlisten] recover cleaning up Sat Jun 29 22:56:46.861 [initandlisten] removeJournalFiles Sat Jun 29 22:56:46.861 [initandlisten] recover done Sat Jun 29 22:56:46.939 [initandlisten] waiting for connections on port 27017 Sat Jun 29 22:56:46.939 [websvr] admin web console waiting for connections on port 28017 Sat Jun 29 22:56:46.939 [rsStart] replSet I am lfdb01.localnet:27017 Sat Jun 29 22:56:46.939 [rsStart] replSet STARTUP2 Sat Jun 29 22:56:46.939 [rsHealthPoll] replset info lfdb02.localnet:27017 thinks that we are down Sat Jun 29 22:56:46.939 [rsHealthPoll] replSet member lfdb02.localnet:27017 is up Sat Jun 29 22:56:46.939 [rsHealthPoll] replSet member lfdb02.localnet:27017 is now in state PRIMARY Sat Jun 29 22:56:47.953 [rsSync] replSet SECONDARY Sat Jun 29 22:56:48.952 [rsHealthPoll] replset info lfweb01.localnet:27017 thinks that we are down Sat Jun 29 22:56:48.952 [rsHealthPoll] replSet member lfweb01.localnet:27017 is up Sat Jun 29 22:56:48.952 [rsHealthPoll] replSet member lfweb01.localnet:27017 is now in state ARBITER Sat Jun 29 22:56:53.023 [rsBackgroundSync] replSet syncing to: lfdb02.localnet:27017 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet our last op time fetched: Jun 29 22:40:59:99 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replset source's GTE: Jun 29 22:41:39:1 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet rollback 0 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet ROLLBACK Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet rollback 1 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet rollback 2 FindCommonPoint Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet info rollback our last optime: Jun 29 22:40:59:99 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet info rollback their last optime: Jun 29 22:56:15:168 Sat Jun 29 22:56:53.101 [rsBackgroundSync] replSet info rollback diff in end of log times: -916 seconds Sat Jun 29 23:10:50.333 [conn15] serverStatus was very slow: { after basic: 0, after asserts: 0, after backgroundFlushing: 0, after connections: 0, after cursors: 0, after dur: 0, after extra_info: 0, after globalLock: 0, after indexCounters: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after recordStats: 1290, after repl: 1290, at end: 1290 } Sat Jun 29 23:10:50.333 [conn15] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 keyUpdates:0 locks(micros) r:28 reslen:4952 2015ms Sat Jun 29 23:13:48.175 [repl writer worker 7] build index SteelCityBuzz.ScheduledTasks { _id: 1 } Sat Jun 29 23:13:48.191 [repl writer worker 7] build index done. scanned 0 total records. 0.015 secs