2015-07-28T22:06:44.041+0300 I JOURNAL [initandlisten] journal dir=/var/lib/mongodb/journal 2015-07-28T22:06:44.041+0300 I JOURNAL [initandlisten] recover : no journal files present, no recovery needed 2015-07-28T22:06:46.461+0300 I JOURNAL [initandlisten] preallocateIsFaster=true 38.7 2015-07-28T22:06:46.996+0300 I JOURNAL [initandlisten] preallocateIsFaster=true 6.06 2015-07-28T22:06:48.718+0300 I JOURNAL [initandlisten] preallocateIsFaster=true 8.1 2015-07-28T22:06:48.718+0300 I JOURNAL [initandlisten] preallocateIsFaster check took 4.676 secs 2015-07-28T22:06:48.718+0300 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.0 2015-07-28T22:06:51.061+0300 I - [initandlisten] File Preallocator Progress: 429916160/1073741824 40% 2015-07-28T22:06:57.733+0300 I - [initandlisten] File Preallocator Progress: 461373440/1073741824 42% 2015-07-28T22:07:00.207+0300 I - [initandlisten] File Preallocator Progress: 545259520/1073741824 50% 2015-07-28T22:07:07.825+0300 I - [initandlisten] File Preallocator Progress: 587202560/1073741824 54% 2015-07-28T22:07:10.213+0300 I - [initandlisten] File Preallocator Progress: 671088640/1073741824 62% 2015-07-28T22:07:13.440+0300 I - [initandlisten] File Preallocator Progress: 713031680/1073741824 66% 2015-07-28T22:07:16.845+0300 I - [initandlisten] File Preallocator Progress: 744488960/1073741824 69% 2015-07-28T22:07:24.109+0300 I - [initandlisten] File Preallocator Progress: 775946240/1073741824 72% 2015-07-28T22:07:27.301+0300 I - [initandlisten] File Preallocator Progress: 859832320/1073741824 80% 2015-07-28T22:07:36.349+0300 I - [initandlisten] File Preallocator Progress: 912261120/1073741824 84% 2015-07-28T22:07:39.516+0300 I - [initandlisten] File Preallocator Progress: 985661440/1073741824 91% 2015-07-28T22:07:42.076+0300 I - [initandlisten] File Preallocator Progress: 1027604480/1073741824 95% 2015-07-28T22:07:45.895+0300 I - [initandlisten] File Preallocator Progress: 1038090240/1073741824 96% 2015-07-28T22:08:02.901+0300 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.1 2015-07-28T22:08:05.388+0300 I - [initandlisten] File Preallocator Progress: 314572800/1073741824 29% 2015-07-28T22:08:13.535+0300 I - [initandlisten] File Preallocator Progress: 367001600/1073741824 34% 2015-07-28T22:08:16.377+0300 I - [initandlisten] File Preallocator Progress: 450887680/1073741824 41% 2015-07-28T22:08:23.605+0300 I - [initandlisten] File Preallocator Progress: 492830720/1073741824 45% 2015-07-28T22:08:26.008+0300 I - [initandlisten] File Preallocator Progress: 608174080/1073741824 56% 2015-07-28T22:08:29.016+0300 I - [initandlisten] File Preallocator Progress: 660602880/1073741824 61% 2015-07-28T22:08:34.687+0300 I - [initandlisten] File Preallocator Progress: 671088640/1073741824 62% 2015-07-28T22:08:37.104+0300 I - [initandlisten] File Preallocator Progress: 754974720/1073741824 70% 2015-07-28T22:08:42.733+0300 I - [initandlisten] File Preallocator Progress: 807403520/1073741824 75% 2015-07-28T22:08:45.348+0300 I - [initandlisten] File Preallocator Progress: 880803840/1073741824 82% 2015-07-28T22:08:52.348+0300 I - [initandlisten] File Preallocator Progress: 933232640/1073741824 86% 2015-07-28T22:08:55.396+0300 I - [initandlisten] File Preallocator Progress: 1038090240/1073741824 96% 2015-07-28T22:08:59.930+0300 I - [initandlisten] File Preallocator Progress: 1059061760/1073741824 98% 2015-07-28T22:09:11.352+0300 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.2 2015-07-28T22:09:14.077+0300 I - [initandlisten] File Preallocator Progress: 314572800/1073741824 29% 2015-07-28T22:09:17.196+0300 I - [initandlisten] File Preallocator Progress: 387973120/1073741824 36% 2015-07-28T22:09:20.126+0300 I - [initandlisten] File Preallocator Progress: 398458880/1073741824 37% 2015-07-28T22:09:25.035+0300 I - [initandlisten] File Preallocator Progress: 534773760/1073741824 49% 2015-07-28T22:09:28.112+0300 I - [initandlisten] File Preallocator Progress: 692060160/1073741824 64% 2015-07-28T22:09:31.175+0300 I - [initandlisten] File Preallocator Progress: 754974720/1073741824 70% 2015-07-28T22:09:34.049+0300 I - [initandlisten] File Preallocator Progress: 870318080/1073741824 81% 2015-07-28T22:09:38.729+0300 I - [initandlisten] File Preallocator Progress: 964689920/1073741824 89% 2015-07-28T22:09:49.537+0300 I JOURNAL [durability] Durability thread started 2015-07-28T22:09:49.539+0300 I JOURNAL [journal writer] Journal writer thread started 2015-07-28T22:09:49.590+0300 I CONTROL [initandlisten] MongoDB starting : pid=11837 port=27017 dbpath=/var/lib/mongodb 64-bit host=Mgmt 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-28T22:09:49.615+0300 I CONTROL [initandlisten] 2015-07-28T22:09:49.617+0300 I CONTROL [initandlisten] db version v3.0.5 2015-07-28T22:09:49.618+0300 I CONTROL [initandlisten] git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3 2015-07-28T22:09:49.618+0300 I CONTROL [initandlisten] build info: Linux ip-10-183-35-50 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-07-28T22:09:49.618+0300 I CONTROL [initandlisten] allocator: tcmalloc 2015-07-28T22:09:49.622+0300 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } ... 2015-07-28T22:15:07.235+0300 I CONTROL ***** SERVER RESTARTED ***** 2015-07-28T22:19:17.767+0300 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty. 2015-07-28T22:19:17.884+0300 I JOURNAL [initandlisten] journal dir=/var/lib/mongodb/journal 2015-07-28T22:19:17.884+0300 I JOURNAL [initandlisten] recover begin 2015-07-28T22:19:17.904+0300 I JOURNAL [initandlisten] recover lsn: 522353 2015-07-28T22:19:17.904+0300 I JOURNAL [initandlisten] recover /var/lib/mongodb/journal/j._0 2015-07-28T22:19:17.929+0300 I JOURNAL [initandlisten] recover skipping application of section seq:0 < lsn:522353 2015-07-28T22:19:17.929+0300 I JOURNAL [initandlisten] recover skipping application of section seq:170560 < lsn:522353 2015-07-28T22:19:17.929+0300 I JOURNAL [initandlisten] recover skipping application of section seq:229829 < lsn:522353 2015-07-28T22:19:17.953+0300 I JOURNAL [initandlisten] recover skipping application of section seq:288350 < lsn:522353 2015-07-28T22:19:17.954+0300 I JOURNAL [initandlisten] recover skipping application of section seq:346958 < lsn:522353 2015-07-28T22:19:17.956+0300 I JOURNAL [initandlisten] recover skipping application of section seq:404361 < lsn:522353 2015-07-28T22:19:17.956+0300 I JOURNAL [initandlisten] recover skipping application of section seq:463425 < lsn:522353 2015-07-28T22:19:18.111+0300 I JOURNAL [initandlisten] recover cleaning up 2015-07-28T22:19:18.111+0300 I JOURNAL [initandlisten] removeJournalFiles 2015-07-28T22:19:18.255+0300 I JOURNAL [initandlisten] recover done 2015-07-28T22:19:18.255+0300 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.0 2015-07-28T22:19:21.066+0300 I - [initandlisten] File Preallocator Progress: 471859200/1073741824 43% 2015-07-28T22:19:25.255+0300 I - [initandlisten] File Preallocator Progress: 608174080/1073741824 56% 2015-07-28T22:19:28.057+0300 I - [initandlisten] File Preallocator Progress: 828375040/1073741824 77% 2015-07-28T22:15:29.033+0300 I JOURNAL [durability] Durability thread started 2015-07-28T22:15:29.033+0300 I JOURNAL [journal writer] Journal writer thread started 2015-07-28T22:15:29.081+0300 I CONTROL [initandlisten] MongoDB starting : pid=940 port=27017 dbpath=/var/lib/mongodb 64-bit host=Mgmt 2015-07-28T22:15:29.083+0300 I CONTROL [initandlisten] 2015-07-28T22:15:29.083+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-07-28T22:15:29.083+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-28T22:15:29.083+0300 I CONTROL [initandlisten] 2015-07-28T22:15:29.083+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] db version v3.0.5 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] build info: Linux ip-10-183-35-50 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] allocator: tcmalloc 2015-07-28T22:15:29.084+0300 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } 2015-07-28T22:15:32.182+0300 I NETWORK [initandlisten] waiting for connections on port 27017 ... 2015-07-29T10:13:44.018+0300 I COMMAND [conn3655] cloneCollection. db:my_db collection:my_db.fs.chunks from: 172.16.100.101:27017 query: { _id: { $in: [ ObjectId('55b87e0f0429ea379c610524') ] } } 2015-07-29T10:13:44.036+0300 F - [conn3655] Invalid access at address: 0xd8 2015-07-29T10:13:44.481+0300 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42091 #7990 (25 connections now open) 2015-07-29T10:13:44.539+0300 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42092 #7991 (26 connections now open) 2015-07-29T10:13:44.573+0300 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42093 #7992 (27 connections now open) 2015-07-29T10:13:44.624+0300 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42094 #7993 (28 connections now open) 2015-07-29T10:13:44.692+0300 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42095 #7994 (29 connections now open) 2015-07-29T10:13:44.892+0300 F - [conn3655] Got signal: 11 (Segmentation fault). 0xf5ba59 0xf5b322 0xf5b67e 0x7feb9f563340 0x922b9a 0x922cb6 0x911769 0x939bf2 0x85801d 0x934fa8 0x936a92 0x949266 0x9d5f64 0x9d6eed 0x9d7bfb 0xb9c776 0xab2b50 0x80e06d 0xf0e9fb 0x7feb9f55b182 0x7feb9e02400d ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B5BA59"},{"b":"400000","o":"B5B322"},{"b":"400000","o":"B5B67E"},{"b":"7FEB9F553000","o":"10340"},{"b":"400000","o":"522B9A"},{"b":"400000","o":"522CB6"},{"b":"400000","o":"511769"},{"b":"400000","o":"539BF2"},{"b":"400000","o":"45801D"},{"b":"400000","o":"534FA8"},{"b":"400000","o":"536A92"},{"b":"400000","o":"549266"},{"b":"400000","o":"5D5F64"},{"b":"400000","o":"5D6EED"},{"b":"400000","o":"5D7BFB"},{"b":"400000","o":"79C776"},{"b":"400000","o":"6B2B50"},{"b":"400000","o":"40E06D"},{"b":"400000","o":"B0E9FB"},{"b":"7FEB9F553000","o":"8182"},{"b":"7FEB9DF29000","o":"FB00D"}],"processInfo":{ "mongodbVersion" : "3.0.5", "gitVersion" : "8bc4ae20708dbb493cb09338d9e7be6698e4a3a3", "uname" : { "sysname" : "Linux", "release" : "3.13.0-24-generic", "version" : "#46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "695FC6828398A9DB1F99718671147885B5ED116D" }, { "b" : "7FFF0D0FE000", "elfType" : 3, "buildId" : "6755FAD2CADACDF1667E5B57FF1EDFC28DD1C976" }, { "b" : "7FEB9F553000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "9318E8AF0BFBE444731BB0461202EF57F7C39542" }, { "b" : "7FEB9F2F5000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "70F9A7F3734C01FF8D442C21A03B631588C2FECD" }, { "b" : "7FEB9EF1B000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "8D6FFA819931E68666BCEF4424BA6289838309D7" }, { "b" : "7FEB9ED13000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "92FCF41EFE012D6186E31A59AD05BDBB487769AB" }, { "b" : "7FEB9EB0F000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "C1AE4CB7195D337A77A3C689051DABAA3980CA0C" }, { "b" : "7FEB9E80B000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "19EFDDAB11B3BF5C71570078C59F91CF6592CE9E" }, { "b" : "7FEB9E505000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "1D76B71E905CB867B27CEF230FCB20F01A3178F5" }, { "b" : "7FEB9E2EF000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "CC0D578C2E0D86237CA7B0CE8913261C506A629A" }, { "b" : "7FEB9DF29000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "882AD7AAD54790E2FA6EF64CA2E6188F06BF9207" }, { "b" : "7FEB9F771000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "9F00581AB3C73E3AEA35995A0C50D24D59A01D47" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf5ba59] mongod(+0xB5B322) [0xf5b322] mongod(+0xB5B67E) [0xf5b67e] libpthread.so.0(+0x10340) [0x7feb9f563340] mongod(_ZN5mongo12IndexCatalog13IndexIteratorC1EPNS_16OperationContextEPKS0_b+0xA) [0x922b9a] mongod(_ZNK5mongo12IndexCatalog11findIdIndexEPNS_16OperationContextE+0x16) [0x922cb6] mongod(_ZN5mongo10Collection14insertDocumentEPNS_16OperationContextERKNS_7BSONObjEb+0x49) [0x911769] mongod(_ZN5mongo6Cloner3FunclERNS_27DBClientCursorBatchIteratorE+0x262) [0x939bf2] mongod(_ZN5mongo18DBClientConnection5queryESt8functionIFvRNS_27DBClientCursorBatchIteratorEEERKSsNS_5QueryEPKNS_7BSONObjEi+0x1AD) [0x85801d] mongod(_ZN5mongo6Cloner4copyEPNS_16OperationContextERKSsRKNS_15NamespaceStringERKNS_7BSONObjES7_bbbbbNS_5QueryE+0x5C8) [0x934fa8] mongod(_ZN5mongo6Cloner14copyCollectionEPNS_16OperationContextERKSsRKNS_7BSONObjERSsbbbb+0x652) [0x936a92] mongod(_ZN5mongo18CmdCloneCollection3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x546) [0x949266] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9d5f64] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC1D) [0x9d6eed] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9d7bfb] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_+0x746) [0xb9c776] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xB10) [0xab2b50] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xDD) [0x80e06d] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x34B) [0xf0e9fb] libpthread.so.0(+0x8182) [0x7feb9f55b182] libc.so.6(clone+0x6D) [0x7feb9e02400d] ----- END BACKTRACE ----- 2015-07-29T10:23:49.875+0300 I CONTROL ***** SERVER RESTARTED ***** 2015-07-29T10:23:50.074+0300 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty. 2015-07-29T10:23:50.180+0300 I JOURNAL [initandlisten] journal dir=/var/lib/mongodb/journal 2015-07-29T10:23:50.180+0300 I JOURNAL [initandlisten] recover begin 2015-07-29T10:23:50.180+0300 I JOURNAL [initandlisten] recover lsn: 41986646 2015-07-29T10:23:50.180+0300 I JOURNAL [initandlisten] recover /var/lib/mongodb/journal/j._0 2015-07-29T10:23:50.200+0300 I JOURNAL [initandlisten] recover skipping application of section seq:0 < lsn:41986646 2015-07-29T10:23:50.200+0300 I JOURNAL [initandlisten] recover skipping application of section seq:34617 < lsn:41986646 2015-07-29T10:23:50.200+0300 I JOURNAL [initandlisten] recover skipping application of section seq:93027 < lsn:41986646 2015-07-29T10:23:50.200+0300 I JOURNAL [initandlisten] recover skipping application of section seq:152000 < lsn:41986646 2015-07-29T10:23:50.381+0300 I JOURNAL [initandlisten] recover skipping application of section seq:210901 < lsn:41986646 2015-07-29T10:23:50.382+0300 I JOURNAL [initandlisten] recover skipping application of section seq:269864 < lsn:41986646 2015-07-29T10:23:50.382+0300 I JOURNAL [initandlisten] recover skipping application of section seq:328777 < lsn:41986646 2015-07-29T10:23:50.391+0300 I JOURNAL [initandlisten] recover skipping application of section seq:387671 < lsn:41986646 2015-07-29T10:23:50.398+0300 I JOURNAL [initandlisten] recover skipping application of section seq:446633 < lsn:41986646 2015-07-29T10:23:50.410+0300 I JOURNAL [initandlisten] recover skipping application of section more... 2015-07-29T10:27:04.692+0300 I JOURNAL [initandlisten] recover cleaning up 2015-07-29T10:27:04.692+0300 I JOURNAL [initandlisten] removeJournalFiles 2015-07-29T10:27:05.103+0300 I JOURNAL [initandlisten] recover done 2015-07-29T10:27:05.103+0300 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.0 2015-07-29T10:27:10.252+0300 I - [initandlisten] File Preallocator Progress: 482344960/1073741824 44% 2015-07-29T10:27:13.090+0300 I - [initandlisten] File Preallocator Progress: 723517440/1073741824 67% 2015-07-29T10:27:16.178+0300 I - [initandlisten] File Preallocator Progress: 870318080/1073741824 81% 2015-07-29T10:27:19.205+0300 I - [initandlisten] File Preallocator Progress: 954204160/1073741824 88% 2015-07-29T10:27:22.102+0300 I - [initandlisten] File Preallocator Progress: 1027604480/1073741824 95% 2015-07-29T10:27:36.267+0300 I JOURNAL [durability] Durability thread started 2015-07-29T10:27:36.267+0300 I JOURNAL [journal writer] Journal writer thread started 2015-07-29T10:27:36.302+0300 I CONTROL [initandlisten] MongoDB starting : pid=955 port=27017 dbpath=/var/lib/mongodb 64-bit host=Mgmt 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] db version v3.0.5 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] build info: Linux ip-10-183-35-50 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] allocator: tcmalloc 2015-07-29T10:27:36.303+0300 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } ... 2015-07-29T10:27:51.181+0300 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2015-07-29T10:27:51.181+0300 I CONTROL [signalProcessingThread] now exiting 2015-07-29T10:27:51.181+0300 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2015-07-29T10:27:51.181+0300 I NETWORK [signalProcessingThread] closing listening socket: 6 2015-07-29T10:27:51.181+0300 I NETWORK [signalProcessingThread] closing listening socket: 7 2015-07-29T10:27:51.183+0300 I STORAGE [conn20] got request after shutdown() 2015-07-29T10:27:51.186+0300 I STORAGE [conn14] got request after shutdown() 2015-07-29T10:27:51.188+0300 I STORAGE [conn17] got request after shutdown() 2015-07-29T10:27:51.191+0300 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27017.sock 2015-07-29T10:27:51.191+0300 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2015-07-29T10:27:51.191+0300 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2015-07-29T10:27:51.191+0300 I STORAGE [signalProcessingThread] shutdown: waiting for fs preallocator... 2015-07-29T10:27:51.191+0300 I STORAGE [signalProcessingThread] shutdown: final commit... 2015-07-29T10:27:51.191+0300 I NETWORK [conn2] end connection 127.0.0.1:50265 (17 connections now open) 2015-07-29T10:27:51.191+0300 I NETWORK [conn3] end connection 127.0.0.1:50267 (17 connections now open) 2015-07-29T10:27:51.191+0300 I NETWORK [conn4] end connection 127.0.0.1:50268 (17 connections now open) 2015-07-29T10:27:51.191+0300 I NETWORK [conn5] end connection 127.0.0.1:50270 (17 connections now open) 2015-07-29T10:27:51.191+0300 I NETWORK [conn6] end connection 127.0.0.1:50280 (17 connections now open) 2015-07-29T10:27:51.191+0300 I NETWORK [conn7] end connection 127.0.0.1:50281 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn8] end connection 127.0.0.1:50282 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn9] end connection 127.0.0.1:50283 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn10] end connection 127.0.0.1:50284 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn11] end connection 127.0.0.1:50285 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn12] end connection 127.0.0.1:50286 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn13] end connection 127.0.0.1:50287 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn15] end connection 127.0.0.1:50289 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn16] end connection 127.0.0.1:50290 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn18] end connection 127.0.0.1:50292 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn19] end connection 127.0.0.1:50293 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn21] end connection 127.0.0.1:50295 (17 connections now open) 2015-07-29T10:27:51.192+0300 I NETWORK [conn22] end connection 127.0.0.1:50296 (17 connections now open) 2015-07-29T10:27:51.232+0300 I JOURNAL [signalProcessingThread] journalCleanup... 2015-07-29T10:27:51.232+0300 I JOURNAL [signalProcessingThread] removeJournalFiles 2015-07-29T10:27:51.260+0300 I JOURNAL [signalProcessingThread] Terminating durability thread ... 2015-07-29T10:27:51.294+0300 I JOURNAL [journal writer] Journal writer thread stopped 2015-07-29T10:27:51.294+0300 I JOURNAL [durability] Durability thread stopped 2015-07-29T10:27:51.294+0300 I STORAGE [signalProcessingThread] shutdown: closing all files... 2015-07-29T10:27:51.295+0300 I STORAGE [signalProcessingThread] closeAllFiles() finished 2015-07-29T10:27:51.295+0300 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2015-07-29T10:27:51.313+0300 I CONTROL [signalProcessingThread] dbexit: rc: 0 2015-07-29T10:30:25.185+0300 I CONTROL ***** SERVER RESTARTED ***** 2015-07-29T10:30:25.541+0300 I JOURNAL [initandlisten] journal dir=/var/lib/mongodb/journal 2015-07-29T10:30:25.547+0300 I JOURNAL [initandlisten] recover : no journal files present, no recovery needed 2015-07-29T10:30:25.598+0300 I JOURNAL [durability] Durability thread started 2015-07-29T10:30:25.599+0300 I JOURNAL [journal writer] Journal writer thread started 2015-07-29T10:30:25.602+0300 I CONTROL [initandlisten] MongoDB starting : pid=942 port=27017 dbpath=/var/lib/mongodb 64-bit host=Mgmt 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] db version v3.0.5 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] build info: Linux ip-10-183-35-50 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] allocator: tcmalloc 2015-07-29T10:30:25.603+0300 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } ... 2015-07-29T10:57:50.272+0300 I COMMAND [conn353] cloneCollection. db:my_db collection:my_db.fs.chunks from: 172.16.100.101:27017 query: { _id: { $in: [ ObjectId('55b886f90429ea0918c63f8a') ] } } 2015-07-29T10:57:50.275+0300 F - [conn353] Invalid access at address: 0xd8 2015-07-29T10:57:50.761+0300 F - [conn353] Got signal: 11 (Segmentation fault). 0xf5ba59 0xf5b322 0xf5b67e 0x7f9e352f4340 0x922b9a 0x922cb6 0x911769 0x939bf2 0x85801d 0x934fa8 0x936a92 0x949266 0x9d5f64 0x9d6eed 0x9d7bfb 0xb9c776 0xab2b50 0x80e06d 0xf0e9fb 0x7f9e352ec182 0x7f9e33db500d ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B5BA59"},{"b":"400000","o":"B5B322"},{"b":"400000","o":"B5B67E"},{"b":"7F9E352E4000","o":"10340"},{"b":"400000","o":"522B9A"},{"b":"400000","o":"522CB6"},{"b":"400000","o":"511769"},{"b":"400000","o":"539BF2"},{"b":"400000","o":"45801D"},{"b":"400000","o":"534FA8"},{"b":"400000","o":"536A92"},{"b":"400000","o":"549266"},{"b":"400000","o":"5D5F64"},{"b":"400000","o":"5D6EED"},{"b":"400000","o":"5D7BFB"},{"b":"400000","o":"79C776"},{"b":"400000","o":"6B2B50"},{"b":"400000","o":"40E06D"},{"b":"400000","o":"B0E9FB"},{"b":"7F9E352E4000","o":"8182"},{"b":"7F9E33CBA000","o":"FB00D"}],"processInfo":{ "mongodbVersion" : "3.0.5", "gitVersion" : "8bc4ae20708dbb493cb09338d9e7be6698e4a3a3", "uname" : { "sysname" : "Linux", "release" : "3.13.0-24-generic", "version" : "#46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "695FC6828398A9DB1F99718671147885B5ED116D" }, { "b" : "7FFFD8AFE000", "elfType" : 3, "buildId" : "6755FAD2CADACDF1667E5B57FF1EDFC28DD1C976" }, { "b" : "7F9E352E4000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "9318E8AF0BFBE444731BB0461202EF57F7C39542" }, { "b" : "7F9E35086000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "70F9A7F3734C01FF8D442C21A03B631588C2FECD" }, { "b" : "7F9E34CAC000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "8D6FFA819931E68666BCEF4424BA6289838309D7" }, { "b" : "7F9E34AA4000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "92FCF41EFE012D6186E31A59AD05BDBB487769AB" }, { "b" : "7F9E348A0000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "C1AE4CB7195D337A77A3C689051DABAA3980CA0C" }, { "b" : "7F9E3459C000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "19EFDDAB11B3BF5C71570078C59F91CF6592CE9E" }, { "b" : "7F9E34296000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "1D76B71E905CB867B27CEF230FCB20F01A3178F5" }, { "b" : "7F9E34080000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "CC0D578C2E0D86237CA7B0CE8913261C506A629A" }, { "b" : "7F9E33CBA000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "882AD7AAD54790E2FA6EF64CA2E6188F06BF9207" }, { "b" : "7F9E35502000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "9F00581AB3C73E3AEA35995A0C50D24D59A01D47" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf5ba59] mongod(+0xB5B322) [0xf5b322] mongod(+0xB5B67E) [0xf5b67e] libpthread.so.0(+0x10340) [0x7f9e352f4340] mongod(_ZN5mongo12IndexCatalog13IndexIteratorC1EPNS_16OperationContextEPKS0_b+0xA) [0x922b9a] mongod(_ZNK5mongo12IndexCatalog11findIdIndexEPNS_16OperationContextE+0x16) [0x922cb6] mongod(_ZN5mongo10Collection14insertDocumentEPNS_16OperationContextERKNS_7BSONObjEb+0x49) [0x911769] mongod(_ZN5mongo6Cloner3FunclERNS_27DBClientCursorBatchIteratorE+0x262) [0x939bf2] mongod(_ZN5mongo18DBClientConnection5queryESt8functionIFvRNS_27DBClientCursorBatchIteratorEEERKSsNS_5QueryEPKNS_7BSONObjEi+0x1AD) [0x85801d] mongod(_ZN5mongo6Cloner4copyEPNS_16OperationContextERKSsRKNS_15NamespaceStringERKNS_7BSONObjES7_bbbbbNS_5QueryE+0x5C8) [0x934fa8] mongod(_ZN5mongo6Cloner14copyCollectionEPNS_16OperationContextERKSsRKNS_7BSONObjERSsbbbb+0x652) [0x936a92] mongod(_ZN5mongo18CmdCloneCollection3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x546) [0x949266] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9d5f64] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC1D) [0x9d6eed] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9d7bfb] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_+0x746) [0xb9c776] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xB10) [0xab2b50] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xDD) [0x80e06d] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x34B) [0xf0e9fb] libpthread.so.0(+0x8182) [0x7f9e352ec182] libc.so.6(clone+0x6D) [0x7f9e33db500d] ----- END BACKTRACE -----