Mon Nov 5 08:40:51 [initandlisten] MongoDB starting : pid=26230 port=27017 dbpath=/mnt/data/db 64-bit host=ip-10-13-30-151 Mon Nov 5 08:40:51 [initandlisten] db version v2.2.1, pdfile version 4.5 Mon Nov 5 08:40:51 [initandlisten] git version: d6764bf8dfe0685521b8bc7b98fd1fab8cfeb5ae Mon Nov 5 08:40:51 [initandlisten] build info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_49 Mon Nov 5 08:40:51 [initandlisten] options: { dbpath: "/mnt/data/db", fork: true, journal: true, logpath: "/mnt/data/log/mongod.log", profile: 1, replSet: "sip1", slowms: 2000 } Mon Nov 5 08:40:51 [initandlisten] journal dir=/mnt/data/db/journal Mon Nov 5 08:40:51 [initandlisten] recover begin Mon Nov 5 08:40:51 [initandlisten] recover lsn: 0 Mon Nov 5 08:40:51 [initandlisten] recover /mnt/data/db/journal/j._0 Mon Nov 5 08:40:51 [initandlisten] recover cleaning up Mon Nov 5 08:40:51 [initandlisten] removeJournalFiles Mon Nov 5 08:40:51 [initandlisten] recover done Mon Nov 5 08:40:51 [initandlisten] preallocating a journal file /mnt/data/db/journal/prealloc.0 Mon Nov 5 08:41:12 [websvr] admin web console waiting for connections on port 28017 Mon Nov 5 08:41:12 [initandlisten] waiting for connections on port 27017 Mon Nov 5 08:41:12 [initandlisten] connection accepted from 10.13.30.151:41326 #1 (1 connection now open) Mon Nov 5 08:41:12 [rsStart] replSet I am ip-10-13-30-151.ec2.internal:27017 Mon Nov 5 08:41:12 [rsStart] replSet STARTUP2 Mon Nov 5 08:41:12 [rsSync] replSet still syncing, not yet to minValid optime 50977aa9:22 Mon Nov 5 08:41:12 [rsHealthPoll] replSet member ip-10-46-113-103.ec2.internal:27017 is up Mon Nov 5 08:41:12 [rsHealthPoll] replSet member ip-10-46-113-103.ec2.internal:27017 is now in state PRIMARY Mon Nov 5 08:41:12 [initandlisten] connection accepted from 10.196.109.134:46792 #2 (2 connections now open) Mon Nov 5 08:41:12 [initandlisten] connection accepted from 10.220.42.6:55726 #3 (3 connections now open) Mon Nov 5 08:41:12 [initandlisten] connection accepted from 10.28.45.184:36989 #4 (4 connections now open) Mon Nov 5 08:41:12 [initandlisten] connection accepted from 10.46.113.103:60507 #5 (5 connections now open) Mon Nov 5 08:41:13 [initandlisten] connection accepted from 10.248.5.56:46257 #6 (6 connections now open) Mon Nov 5 08:41:13 [initandlisten] connection accepted from 10.29.162.244:54658 #7 (7 connections now open) Mon Nov 5 08:41:14 [rsHealthPoll] replSet member ip-10-29-162-244.ec2.internal:27017 is up Mon Nov 5 08:41:14 [rsHealthPoll] replSet member ip-10-29-162-244.ec2.internal:27017 is now in state ARBITER Mon Nov 5 08:41:14 [conn5] end connection 10.46.113.103:60507 (6 connections now open) Mon Nov 5 08:41:14 [initandlisten] connection accepted from 10.46.113.103:60508 #8 (7 connections now open) Mon Nov 5 08:41:15 [initandlisten] connection accepted from 10.243.94.95:33617 #9 (8 connections now open) Mon Nov 5 08:41:19 [rsBackgroundSync] replSet syncing to: ip-10-46-113-103.ec2.internal:27017 Mon Nov 5 08:41:19 [rsSync] replSet still syncing, not yet to minValid optime 50977aa9:22 Mon Nov 5 08:41:19 [repl writer worker 4] ERROR: writer worker caught exception: E11000 duplicate key error index: clips.clips.$_id_ dup key: { : "yt_9Xvn_Ku55cI" } on: { ts: Timestamp 1352104616000|54, h: 1142859144383117908, op: "u", ns: "clips.clips", o2: { _id: "yt_9Xvn_Ku55cI", sp: { $size: 2 } }, o: { $set: { art: "Mika" }, $set: { cat: "music" }, $set: { cid: "9Xvn_Ku55cI" }, $set: { cmc: 3801 }, $set: { drt: 217.0 }, $set: { dsc: "Music video by MIKA performing Relax, Take It Easy. (C) 2006 Casablanca Music, LLC" }, $set: { dtl: "MIKA - Relax, Take It Easy (New Version)" }, $set: { fvc: 21539 }, $set: { lfm: new Date(1352059246311) }, $set: { lkc: 17526 }, $set: { lu: new Date(1352104616531) }, $set: { mtl: "Relax, Take It Easy" }, $set: { ptc: 2920 }, $set: { rmtmb: "http://userserve-ak.last.fm/serve/126/71533888.png" }, $set: { rstmb: "http://userserve-ak.last.fm/serve/64s/71533888.png" }, $set: { rtc: 21742 }, $set: { rte: 4.947935104370117 }, $set: { rtmb: "http://userserve-ak.last.fm/serve/300x300/71533888.png" }, $push: { sp: "tw_265372111273611265" }, $set: { src: "http://youtube.com/watch?v=9Xvn_Ku55cI" }, $set: { tgs: [ "MIKA", "Casablanca", "Records/Island", "UK", "Pop" ] }, $set: { tmb: "http://i.ytimg.com/vi/9Xvn_Ku55cI/0.jpg" }, $set: { typ: "youtube" }, $set: { vwc: 8678168 } } } Mon Nov 5 08:41:19 [repl writer worker 4] Fatal Assertion 16360 0xaf8c41 0xabe223 0x99b83e 0xacc4cd 0xb3ec79 0x7fbf80edc851 0x7fbf8028211d /home/ec2-user/mongo/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /home/ec2-user/mongo/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xabe223] /home/ec2-user/mongo/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x13e) [0x99b83e] /home/ec2-user/mongo/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /home/ec2-user/mongo/bin/mongod() [0xb3ec79] /lib64/libpthread.so.0(+0x7851) [0x7fbf80edc851] /lib64/libc.so.6(clone+0x6d) [0x7fbf8028211d] Mon Nov 5 08:41:19 [repl writer worker 4] ***aborting after fassert() failure Mon Nov 5 08:41:19 Got signal: 6 (Aborted). Mon Nov 5 08:41:19 Backtrace: 0xaf8c41 0x5586c9 0x7fbf801cc920 0x7fbf801cc8a5 0x7fbf801ce085 0xabe25e 0x99b83e 0xacc4cd 0xb3ec79 0x7fbf80edc851 0x7fbf8028211d /home/ec2-user/mongo/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /home/ec2-user/mongo/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x5586c9] /lib64/libc.so.6(+0x32920) [0x7fbf801cc920] /lib64/libc.so.6(gsignal+0x35) [0x7fbf801cc8a5] /lib64/libc.so.6(abort+0x175) [0x7fbf801ce085] /home/ec2-user/mongo/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xabe25e] /home/ec2-user/mongo/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x13e) [0x99b83e] /home/ec2-user/mongo/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /home/ec2-user/mongo/bin/mongod() [0xb3ec79] /lib64/libpthread.so.0(+0x7851) [0x7fbf80edc851] /lib64/libc.so.6(clone+0x6d) [0x7fbf8028211d]