***** SERVER RESTARTED *****


Tue Dec 31 12:16:44.707 [initandlisten] MongoDB starting : pid=20463 port=27017 dbpath=/path/to/mongodb 64-bit host=monitor.mobpro.com
Tue Dec 31 12:16:44.707 [initandlisten] db version v2.4.8
Tue Dec 31 12:16:44.707 [initandlisten] git version: a350fc38922fbda2cec8d5dd842237b904eafc14
Tue Dec 31 12:16:44.707 [initandlisten] build info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LI
B_VERSION=1_49
Tue Dec 31 12:16:44.707 [initandlisten] allocator: tcmalloc
Tue Dec 31 12:16:44.707 [initandlisten] options: { config: "/etc/mongodb.conf", dbpath: "/path/to/mongodb", directoryperdb: "true", logappend: "true", log
path: "/var/log/mongodb/mongodb.log", replSet: "rtbreplset" }
Tue Dec 31 12:16:44.841 [initandlisten] journal dir=/path/to/mongodb/journal
Tue Dec 31 12:16:44.841 [initandlisten] recover begin
Tue Dec 31 12:16:44.860 [initandlisten] recover lsn: 286899548
Tue Dec 31 12:16:44.860 [initandlisten] recover /path/to/mongodb/journal/j._60
Tue Dec 31 12:16:50.481 [initandlisten] recover cleaning up
Tue Dec 31 12:16:50.481 [initandlisten] removeJournalFiles
Tue Dec 31 12:16:50.587 [initandlisten] recover done
Tue Dec 31 12:16:50.587 [initandlisten] preallocating a journal file /path/to/mongodb/journal/prealloc.0
Tue Dec 31 12:17:04.455 [websvr] admin web console waiting for connections on port 28017
Tue Dec 31 12:17:04.462 [initandlisten] waiting for connections on port 27017
Tue Dec 31 12:17:04.510 [rsStart] replSet I am 10.11.12.11:27017
Tue Dec 31 12:17:04.510 [rsStart] replSet STARTUP2
Tue Dec 31 12:17:05.510 [rsSync] replSet still syncing, not yet to minValid optime 52c27347:84
Tue Dec 31 12:17:05.511 [rsHealthPoll] replset info 1.2.3.4:27017 thinks that we are down
Tue Dec 31 12:17:05.512 [rsHealthPoll] replSet member 1.2.3.4:27017 is up
Tue Dec 31 12:17:05.512 [rsHealthPoll] replSet member 1.2.3.4:27017 is now in state PRIMARY
Tue Dec 31 12:17:05.524 [initandlisten] connection accepted from 1.2.3.4:37487 #1 (1 connection now open)
Tue Dec 31 12:17:05.524 [conn1] end connection 1.2.3.4:37487 (0 connections now open)
Tue Dec 31 12:17:05.525 [initandlisten] connection accepted from 1.2.3.4:37488 #2 (1 connection now open)
Tue Dec 31 12:17:12.511 [rsBackgroundSync] replSet syncing to: 1.2.3.4:27017
Tue Dec 31 12:17:12.511 [rsSync] replSet still syncing, not yet to minValid optime 52c27347:84
Tue Dec 31 12:17:12.545 [rsSyncNotifier] replset setting oplog notifier to 1.2.3.4:27017
Tue Dec 31 12:17:14.461 [initandlisten] connection accepted from 1.2.3.4:37489 #3 (2 connections now open)
Tue Dec 31 12:17:17.531 [conn2] end connection 1.2.3.4:37488 (1 connection now open)
Tue Dec 31 12:17:17.531 [initandlisten] connection accepted from 1.2.3.4:37491 #4 (2 connections now open)
Tue Dec 31 12:17:17.789 [rsSync] replSet SECONDARY
Tue Dec 31 12:17:18.183 [repl writer worker 1] info: indexing in foreground on this replica; was a background index build on the primary
Tue Dec 31 12:17:18.183 [repl writer worker 1] build index foo.foo { _pm: 1.0 }
tcmalloc: large alloc 18446744073336291328 bytes == (nil) @ 
Tue Dec 31 12:17:18.330 out of memory, printing stack and exiting:
0xde05e1 0x6cf37e 0x12129fd 0x9416b7 0x9dd707 0x9e1adf 0x9e2451 0xac0605 0xac4e12 0xa6d9cf 0xc29713 0xc28e58 0xdadf21 0xe28e69 0x7f20492fdb50 0x7f20486a0a7d 
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
 /usr/bin/mongod(_ZN5mongo14my_new_handlerEv+0x3e) [0x6cf37e]
 /usr/bin/mongod(_Znam+0x6d) [0x12129fd]
 /usr/bin/mongod(_ZN5mongo21BSONObjExternalSorter3addERKNS_7BSONObjERKNS_7DiskLocEb+0x247) [0x9416b7]
 /usr/bin/mongod(_ZN5mongo17addKeysToPhaseOneEPKcRKNS_12IndexDetailsERKNS_7BSONObjEPNS_12SortPhaseOneElPNS_13ProgressMeterEb+0x297) [0x9dd707]
 /usr/bin/mongod(_ZN5mongo14fastBuildIndexEPKcPNS_16NamespaceDetailsERNS_12IndexDetailsEb+0x103f) [0x9e1adf]
 /usr/bin/mongod(_ZN5mongo12buildAnIndexERKSsPNS_16NamespaceDetailsERNS_12IndexDetailsEbb+0x1b1) [0x9e2451]
 /usr/bin/mongod(_ZN5mongo16insert_makeIndexEPNS_16NamespaceDetailsERKSsRKNS_7DiskLocEb+0x2b5) [0xac0605]
 /usr/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibbbPb+0x7d2) [0xac4e12]
 /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0x82f) [0xa6d9cf]
 /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x713) [0xc29713]
 /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x48) [0xc28e58]
 /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdadf21]
 /usr/bin/mongod() [0xe28e69]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f20492fdb50]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f20486a0a7d]