2 17-12-17T08:24:15.390-0500 I CONTROL [initandlisten] MongoDB starting : pid=548 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] modules: none 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] build environment: 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-17T08:24:15.390-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-17T08:24:15.422-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-17T08:24:15.422-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-17T08:24:15.436-0500 E STORAGE [initandlisten] WiredTiger (0) [1513517055:436011][548:0x7f9ba83f3d40], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1634628197 doesn't match expected checksum of 2995010700 2017-12-17T08:24:15.436-0500 E STORAGE [initandlisten] WiredTiger (0) [1513517055:436063][548:0x7f9ba83f3d40], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value 2017-12-17T08:24:15.436-0500 E STORAGE [initandlisten] WiredTiger (-31804) [1513517055:436079][548:0x7f9ba83f3d40], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2017-12-17T08:24:15.436-0500 I - [initandlisten] Fatal Assertion 28558 2017-12-17T08:24:15.436-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-17T08:24:15.460-0500 F - [initandlisten] Got signal: 6 (Aborted). 0x1337cb2 0x1336be9 0x13373f2 0x7f9ba70e3710 0x7f9ba6d72625 0x7f9ba6d73e05 0x12bea52 0x10af8d3 0x1a9f62c 0x1a9faed 0x1a9fed4 0x19d18fc 0x19d1e73 0x19cee15 0x19d2eb9 0x19ef92c 0x1a257c0 0x1a9e357 0x1a9e899 0x1a9e9bb 0x1a33db8 0x1a9b515 0x1a660ef 0x1a661ee 0x1a223a1 0x1097517 0x1093893 0xfbad38 0x9970dd 0x99acbd 0x7f9ba6d5ed5d 0x9937e9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F37CB2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F36BE9"},{"b":"400000","o":"F373F2"},{"b":"7F9BA70D4000","o":"F710"},{"b":"7F9BA6D40000","o":"32625","s":"gsignal"},{"b":"7F9BA6D40000","o":"33E05","s":"abort"},{"b":"400000","o":"EBEA52","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAF8D3"},{"b":"400000","o":"169F62C","s":"__wt_eventv"},{"b":"400000","o":"169FAED","s":"__wt_err"},{"b":"400000","o":"169FED4","s":"__wt_panic"},{"b":"400000","o":"15D18FC","s":"__wt_block_extlist_read"},{"b":"400000","o":"15D1E73","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"15CEE15","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"15D2EB9"},{"b":"400000","o":"15EF92C","s":"__wt_btree_open"},{"b":"400000","o":"16257C0","s":"__wt_conn_btree_open"},{"b":"400000","o":"169E357","s":"__wt_session_get_btree"},{"b":"400000","o":"169E899","s":"__wt_session_get_btree"},{"b":"400000","o":"169E9BB","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"1633DB8","s":"__wt_curfile_open"},{"b":"400000","o":"169B515"},{"b":"400000","o":"16660EF","s":"__wt_metadata_cursor_open"},{"b":"400000","o":"16661EE","s":"__wt_metadata_cursor"},{"b":"400000","o":"16223A1","s":"wiredtiger_open"},{"b":"400000","o":"C97517","s":"_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb"},{"b":"400000","o":"C93893"},{"b":"400000","o":"BBAD38","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"5970DD","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"59ACBD","s":"main"},{"b":"7F9BA6D40000","o":"1ED5D","s":"__libc_start_main"},{"b":"400000","o":"5937E9"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "2.6.32-042stab123.2", "version" : "#1 SMP Mon Apr 17 17:27:00 MSK 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "D6BB40ACB6CFEAA43C3A651DDD8E547FCFE19166" }, { "b" : "7FFC9A223000", "elfType" : 3, "buildId" : "533CF5AD95A05EFC8DF9CE63034292313B26B1DD" }, { "b" : "7F9BA7F7C000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F9BA7B97000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F9BA798F000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "583411D8786F86A1D6B8741C502831E6122445A7" }, { "b" : "7F9BA778B000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "454F8FC6CC6502C6401E5F9E221564D80665D277" }, { "b" : "7F9BA7507000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "7D8E9374F4A4EA38A7C1E763F32240EA113E4208" }, { "b" : "7F9BA72F1000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "BC7550A8A7C2D706FE4E489058BADC963465DBB7" }, { "b" : "7F9BA70D4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B8DFF8E53D9F2B80C3C382E83EC17C828B536A39" }, { "b" : "7F9BA6D40000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "C78F2F16F8C2F9DB39CFCE348794BD92CA56499D" }, { "b" : "7F9BA81E8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F8E59B70E469F3A924A268911FF8FD0C37E7460" }, { "b" : "7F9BA6AFC000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "b" : "7F9BA6815000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "b" : "7F9BA6611000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "b" : "7F9BA63E5000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "b" : "7F9BA61CF000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F9BA5FC4000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "b" : "7F9BA5DC1000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F9BA5BA7000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F8B68F301C19BF06AF56B4B06E0A69F89D2C1F8D" }, { "b" : "7F9BA5988000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1337cb2] mongod(+0xF36BE9) [0x1336be9] mongod(+0xF373F2) [0x13373f2] libpthread.so.0(+0xF710) [0x7f9ba70e3710] libc.so.6(gsignal+0x35) [0x7f9ba6d72625] libc.so.6(abort+0x175) [0x7f9ba6d73e05] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x12bea52] mongod(+0xCAF8D3) [0x10af8d3] mongod(__wt_eventv+0x42C) [0x1a9f62c] mongod(__wt_err+0x8D) [0x1a9faed] mongod(__wt_panic+0x24) [0x1a9fed4] mongod(__wt_block_extlist_read+0x6C) [0x19d18fc] mongod(__wt_block_extlist_read_avail+0x33) [0x19d1e73] mongod(__wt_block_checkpoint_load+0x3C5) [0x19cee15] mongod(+0x15D2EB9) [0x19d2eb9] mongod(__wt_btree_open+0xC7C) [0x19ef92c] mongod(__wt_conn_btree_open+0x140) [0x1a257c0] mongod(__wt_session_get_btree+0xE7) [0x1a9e357] mongod(__wt_session_get_btree+0x629) [0x1a9e899] mongod(__wt_session_get_btree_ckpt+0xAB) [0x1a9e9bb] mongod(__wt_curfile_open+0x218) [0x1a33db8] mongod(+0x169B515) [0x1a9b515] mongod(__wt_metadata_cursor_open+0x5F) [0x1a660ef] mongod(__wt_metadata_cursor+0x7E) [0x1a661ee] mongod(wiredtiger_open+0x1541) [0x1a223a1] mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb+0x567) [0x1097517] mongod(+0xC93893) [0x1093893] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xfbad38] mongod(_ZN5mongo13initAndListenEi+0x3DD) [0x9970dd] mongod(main+0x15D) [0x99acbd] libc.so.6(__libc_start_main+0xFD) [0x7f9ba6d5ed5d] mongod(+0x5937E9) [0x9937e9] ----- END BACKTRACE ----- 2017-12-17T20:47:46.878-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] MongoDB starting : pid=724 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] modules: none 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] build environment: 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-17T20:47:46.890-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-17T20:47:46.937-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-17T20:47:46.937-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-17T20:47:46.981-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561666:981954][724:0x7f4904df3d40], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1634628197 doesn't match expected checksum of 2995010700 2017-12-17T20:47:46.982-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561666:982026][724:0x7f4904df3d40], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value 2017-12-17T20:47:46.982-0500 E STORAGE [initandlisten] WiredTiger (-31804) [1513561666:982053][724:0x7f4904df3d40], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2017-12-17T20:47:46.982-0500 I - [initandlisten] Fatal Assertion 28558 2017-12-17T20:47:46.982-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-17T20:47:47.019-0500 F - [initandlisten] Got signal: 6 (Aborted). 0x1337cb2 0x1336be9 0x13373f2 0x7f4903ae3710 0x7f4903772625 0x7f4903773e05 0x12bea52 0x10af8d3 0x1a9f62c 0x1a9faed 0x1a9fed4 0x19d18fc 0x19d1e73 0x19cee15 0x19d2eb9 0x19ef92c 0x1a257c0 0x1a9e357 0x1a9e899 0x1a9e9bb 0x1a33db8 0x1a9b515 0x1a660ef 0x1a661ee 0x1a223a1 0x1097517 0x1093893 0xfbad38 0x9970dd 0x99acbd 0x7f490375ed5d 0x9937e9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F37CB2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F36BE9"},{"b":"400000","o":"F373F2"},{"b":"7F4903AD4000","o":"F710"},{"b":"7F4903740000","o":"32625","s":"gsignal"},{"b":"7F4903740000","o":"33E05","s":"abort"},{"b":"400000","o":"EBEA52","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAF8D3"},{"b":"400000","o":"169F62C","s":"__wt_eventv"},{"b":"400000","o":"169FAED","s":"__wt_err"},{"b":"400000","o":"169FED4","s":"__wt_panic"},{"b":"400000","o":"15D18FC","s":"__wt_block_extlist_read"},{"b":"400000","o":"15D1E73","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"15CEE15","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"15D2EB9"},{"b":"400000","o":"15EF92C","s":"__wt_btree_open"},{"b":"400000","o":"16257C0","s":"__wt_conn_btree_open"},{"b":"400000","o":"169E357","s":"__wt_session_get_btree"},{"b":"400000","o":"169E899","s":"__wt_session_get_btree"},{"b":"400000","o":"169E9BB","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"1633DB8","s":"__wt_curfile_open"},{"b":"400000","o":"169B515"},{"b":"400000","o":"16660EF","s":"__wt_metadata_cursor_open"},{"b":"400000","o":"16661EE","s":"__wt_metadata_cursor"},{"b":"400000","o":"16223A1","s":"wiredtiger_open"},{"b":"400000","o":"C97517","s":"_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb"},{"b":"400000","o":"C93893"},{"b":"400000","o":"BBAD38","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"5970DD","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"59ACBD","s":"main"},{"b":"7F4903740000","o":"1ED5D","s":"__libc_start_main"},{"b":"400000","o":"5937E9"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "2.6.32-042stab123.2", "version" : "#1 SMP Mon Apr 17 17:27:00 MSK 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "D6BB40ACB6CFEAA43C3A651DDD8E547FCFE19166" }, { "b" : "7FFF38FB9000", "elfType" : 3, "buildId" : "533CF5AD95A05EFC8DF9CE63034292313B26B1DD" }, { "b" : "7F490497C000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F4904597000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F490438F000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "583411D8786F86A1D6B8741C502831E6122445A7" }, { "b" : "7F490418B000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "454F8FC6CC6502C6401E5F9E221564D80665D277" }, { "b" : "7F4903F07000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "7D8E9374F4A4EA38A7C1E763F32240EA113E4208" }, { "b" : "7F4903CF1000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "BC7550A8A7C2D706FE4E489058BADC963465DBB7" }, { "b" : "7F4903AD4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B8DFF8E53D9F2B80C3C382E83EC17C828B536A39" }, { "b" : "7F4903740000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "C78F2F16F8C2F9DB39CFCE348794BD92CA56499D" }, { "b" : "7F4904BE8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F8E59B70E469F3A924A268911FF8FD0C37E7460" }, { "b" : "7F49034FC000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "b" : "7F4903215000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "b" : "7F4903011000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "b" : "7F4902DE5000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "b" : "7F4902BCF000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F49029C4000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "b" : "7F49027C1000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F49025A7000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F8B68F301C19BF06AF56B4B06E0A69F89D2C1F8D" }, { "b" : "7F4902388000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1337cb2] mongod(+0xF36BE9) [0x1336be9] mongod(+0xF373F2) [0x13373f2] libpthread.so.0(+0xF710) [0x7f4903ae3710] libc.so.6(gsignal+0x35) [0x7f4903772625] libc.so.6(abort+0x175) [0x7f4903773e05] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x12bea52] mongod(+0xCAF8D3) [0x10af8d3] mongod(__wt_eventv+0x42C) [0x1a9f62c] mongod(__wt_err+0x8D) [0x1a9faed] mongod(__wt_panic+0x24) [0x1a9fed4] mongod(__wt_block_extlist_read+0x6C) [0x19d18fc] mongod(__wt_block_extlist_read_avail+0x33) [0x19d1e73] mongod(__wt_block_checkpoint_load+0x3C5) [0x19cee15] mongod(+0x15D2EB9) [0x19d2eb9] mongod(__wt_btree_open+0xC7C) [0x19ef92c] mongod(__wt_conn_btree_open+0x140) [0x1a257c0] mongod(__wt_session_get_btree+0xE7) [0x1a9e357] mongod(__wt_session_get_btree+0x629) [0x1a9e899] mongod(__wt_session_get_btree_ckpt+0xAB) [0x1a9e9bb] mongod(__wt_curfile_open+0x218) [0x1a33db8] mongod(+0x169B515) [0x1a9b515] mongod(__wt_metadata_cursor_open+0x5F) [0x1a660ef] mongod(__wt_metadata_cursor+0x7E) [0x1a661ee] mongod(wiredtiger_open+0x1541) [0x1a223a1] mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb+0x567) [0x1097517] mongod(+0xC93893) [0x1093893] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xfbad38] mongod(_ZN5mongo13initAndListenEi+0x3DD) [0x9970dd] mongod(main+0x15D) [0x99acbd] libc.so.6(__libc_start_main+0xFD) [0x7f490375ed5d] mongod(+0x5937E9) [0x9937e9] ----- END BACKTRACE ----- 2017-12-17T20:49:05.753-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] MongoDB starting : pid=733 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] modules: none 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] build environment: 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-17T20:49:05.762-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-17T20:49:05.796-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-17T20:49:05.796-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-17T20:49:05.809-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561745:809388][733:0x7f3e28680d40], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1634628197 doesn't match expected checksum of 2995010700 2017-12-17T20:49:05.809-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561745:809435][733:0x7f3e28680d40], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value 2017-12-17T20:49:05.809-0500 E STORAGE [initandlisten] WiredTiger (-31804) [1513561745:809451][733:0x7f3e28680d40], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2017-12-17T20:49:05.809-0500 I - [initandlisten] Fatal Assertion 28558 2017-12-17T20:49:05.809-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-17T20:49:05.838-0500 F - [initandlisten] Got signal: 6 (Aborted). 0x1337cb2 0x1336be9 0x13373f2 0x7f3e27370710 0x7f3e26fff625 0x7f3e27000e05 0x12bea52 0x10af8d3 0x1a9f62c 0x1a9faed 0x1a9fed4 0x19d18fc 0x19d1e73 0x19cee15 0x19d2eb9 0x19ef92c 0x1a257c0 0x1a9e357 0x1a9e899 0x1a9e9bb 0x1a33db8 0x1a9b515 0x1a660ef 0x1a661ee 0x1a223a1 0x1097517 0x1093893 0xfbad38 0x9970dd 0x99acbd 0x7f3e26febd5d 0x9937e9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F37CB2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F36BE9"},{"b":"400000","o":"F373F2"},{"b":"7F3E27361000","o":"F710"},{"b":"7F3E26FCD000","o":"32625","s":"gsignal"},{"b":"7F3E26FCD000","o":"33E05","s":"abort"},{"b":"400000","o":"EBEA52","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAF8D3"},{"b":"400000","o":"169F62C","s":"__wt_eventv"},{"b":"400000","o":"169FAED","s":"__wt_err"},{"b":"400000","o":"169FED4","s":"__wt_panic"},{"b":"400000","o":"15D18FC","s":"__wt_block_extlist_read"},{"b":"400000","o":"15D1E73","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"15CEE15","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"15D2EB9"},{"b":"400000","o":"15EF92C","s":"__wt_btree_open"},{"b":"400000","o":"16257C0","s":"__wt_conn_btree_open"},{"b":"400000","o":"169E357","s":"__wt_session_get_btree"},{"b":"400000","o":"169E899","s":"__wt_session_get_btree"},{"b":"400000","o":"169E9BB","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"1633DB8","s":"__wt_curfile_open"},{"b":"400000","o":"169B515"},{"b":"400000","o":"16660EF","s":"__wt_metadata_cursor_open"},{"b":"400000","o":"16661EE","s":"__wt_metadata_cursor"},{"b":"400000","o":"16223A1","s":"wiredtiger_open"},{"b":"400000","o":"C97517","s":"_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb"},{"b":"400000","o":"C93893"},{"b":"400000","o":"BBAD38","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"5970DD","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"59ACBD","s":"main"},{"b":"7F3E26FCD000","o":"1ED5D","s":"__libc_start_main"},{"b":"400000","o":"5937E9"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "2.6.32-042stab123.2", "version" : "#1 SMP Mon Apr 17 17:27:00 MSK 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "D6BB40ACB6CFEAA43C3A651DDD8E547FCFE19166" }, { "b" : "7FFE07484000", "elfType" : 3, "buildId" : "533CF5AD95A05EFC8DF9CE63034292313B26B1DD" }, { "b" : "7F3E28209000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F3E27E24000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F3E27C1C000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "583411D8786F86A1D6B8741C502831E6122445A7" }, { "b" : "7F3E27A18000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "454F8FC6CC6502C6401E5F9E221564D80665D277" }, { "b" : "7F3E27794000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "7D8E9374F4A4EA38A7C1E763F32240EA113E4208" }, { "b" : "7F3E2757E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "BC7550A8A7C2D706FE4E489058BADC963465DBB7" }, { "b" : "7F3E27361000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B8DFF8E53D9F2B80C3C382E83EC17C828B536A39" }, { "b" : "7F3E26FCD000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "C78F2F16F8C2F9DB39CFCE348794BD92CA56499D" }, { "b" : "7F3E28475000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F8E59B70E469F3A924A268911FF8FD0C37E7460" }, { "b" : "7F3E26D89000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "b" : "7F3E26AA2000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "b" : "7F3E2689E000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "b" : "7F3E26672000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "b" : "7F3E2645C000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F3E26251000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "b" : "7F3E2604E000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F3E25E34000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F8B68F301C19BF06AF56B4B06E0A69F89D2C1F8D" }, { "b" : "7F3E25C15000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1337cb2] mongod(+0xF36BE9) [0x1336be9] mongod(+0xF373F2) [0x13373f2] libpthread.so.0(+0xF710) [0x7f3e27370710] libc.so.6(gsignal+0x35) [0x7f3e26fff625] libc.so.6(abort+0x175) [0x7f3e27000e05] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x12bea52] mongod(+0xCAF8D3) [0x10af8d3] mongod(__wt_eventv+0x42C) [0x1a9f62c] mongod(__wt_err+0x8D) [0x1a9faed] mongod(__wt_panic+0x24) [0x1a9fed4] mongod(__wt_block_extlist_read+0x6C) [0x19d18fc] mongod(__wt_block_extlist_read_avail+0x33) [0x19d1e73] mongod(__wt_block_checkpoint_load+0x3C5) [0x19cee15] mongod(+0x15D2EB9) [0x19d2eb9] mongod(__wt_btree_open+0xC7C) [0x19ef92c] mongod(__wt_conn_btree_open+0x140) [0x1a257c0] mongod(__wt_session_get_btree+0xE7) [0x1a9e357] mongod(__wt_session_get_btree+0x629) [0x1a9e899] mongod(__wt_session_get_btree_ckpt+0xAB) [0x1a9e9bb] mongod(__wt_curfile_open+0x218) [0x1a33db8] mongod(+0x169B515) [0x1a9b515] mongod(__wt_metadata_cursor_open+0x5F) [0x1a660ef] mongod(__wt_metadata_cursor+0x7E) [0x1a661ee] mongod(wiredtiger_open+0x1541) [0x1a223a1] mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb+0x567) [0x1097517] mongod(+0xC93893) [0x1093893] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xfbad38] mongod(_ZN5mongo13initAndListenEi+0x3DD) [0x9970dd] mongod(main+0x15D) [0x99acbd] libc.so.6(__libc_start_main+0xFD) [0x7f3e26febd5d] mongod(+0x5937E9) [0x9937e9] ----- END BACKTRACE ----- 2017-12-17T20:49:14.381-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] MongoDB starting : pid=737 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] modules: none 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] build environment: 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-17T20:49:14.389-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, repair: true, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-17T20:49:14.431-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-17T20:49:14.431-0500 I STORAGE [initandlisten] Detected WT journal files. Running recovery from last checkpoint. 2017-12-17T20:49:14.431-0500 I STORAGE [initandlisten] journal to nojournal transition config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-17T20:49:14.444-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561754:444981][737:0x7f6131776d40], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1634628197 doesn't match expected checksum of 2995010700 2017-12-17T20:49:14.445-0500 E STORAGE [initandlisten] WiredTiger (0) [1513561754:445032][737:0x7f6131776d40], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value 2017-12-17T20:49:14.445-0500 E STORAGE [initandlisten] WiredTiger (-31804) [1513561754:445048][737:0x7f6131776d40], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2017-12-17T20:49:14.445-0500 I - [initandlisten] Fatal Assertion 28558 2017-12-17T20:49:14.445-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-17T20:49:14.471-0500 F - [initandlisten] Got signal: 6 (Aborted). 0x1337cb2 0x1336be9 0x13373f2 0x7f6130466710 0x7f61300f5625 0x7f61300f6e05 0x12bea52 0x10af8d3 0x1a9f62c 0x1a9faed 0x1a9fed4 0x19d18fc 0x19d1e73 0x19cee15 0x19d2eb9 0x19ef92c 0x1a257c0 0x1a9e357 0x1a9e899 0x1a9e9bb 0x1a33db8 0x1a9b515 0x1a660ef 0x1a661ee 0x1a223a1 0x109741f 0x1093893 0xfbad38 0x9970dd 0x99acbd 0x7f61300e1d5d 0x9937e9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F37CB2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F36BE9"},{"b":"400000","o":"F373F2"},{"b":"7F6130457000","o":"F710"},{"b":"7F61300C3000","o":"32625","s":"gsignal"},{"b":"7F61300C3000","o":"33E05","s":"abort"},{"b":"400000","o":"EBEA52","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAF8D3"},{"b":"400000","o":"169F62C","s":"__wt_eventv"},{"b":"400000","o":"169FAED","s":"__wt_err"},{"b":"400000","o":"169FED4","s":"__wt_panic"},{"b":"400000","o":"15D18FC","s":"__wt_block_extlist_read"},{"b":"400000","o":"15D1E73","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"15CEE15","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"15D2EB9"},{"b":"400000","o":"15EF92C","s":"__wt_btree_open"},{"b":"400000","o":"16257C0","s":"__wt_conn_btree_open"},{"b":"400000","o":"169E357","s":"__wt_session_get_btree"},{"b":"400000","o":"169E899","s":"__wt_session_get_btree"},{"b":"400000","o":"169E9BB","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"1633DB8","s":"__wt_curfile_open"},{"b":"400000","o":"169B515"},{"b":"400000","o":"16660EF","s":"__wt_metadata_cursor_open"},{"b":"400000","o":"16661EE","s":"__wt_metadata_cursor"},{"b":"400000","o":"16223A1","s":"wiredtiger_open"},{"b":"400000","o":"C9741F","s":"_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb"},{"b":"400000","o":"C93893"},{"b":"400000","o":"BBAD38","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"5970DD","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"59ACBD","s":"main"},{"b":"7F61300C3000","o":"1ED5D","s":"__libc_start_main"},{"b":"400000","o":"5937E9"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "2.6.32-042stab123.2", "version" : "#1 SMP Mon Apr 17 17:27:00 MSK 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "D6BB40ACB6CFEAA43C3A651DDD8E547FCFE19166" }, { "b" : "7FFC44AE5000", "elfType" : 3, "buildId" : "533CF5AD95A05EFC8DF9CE63034292313B26B1DD" }, { "b" : "7F61312FF000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F6130F1A000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F6130D12000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "583411D8786F86A1D6B8741C502831E6122445A7" }, { "b" : "7F6130B0E000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "454F8FC6CC6502C6401E5F9E221564D80665D277" }, { "b" : "7F613088A000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "7D8E9374F4A4EA38A7C1E763F32240EA113E4208" }, { "b" : "7F6130674000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "BC7550A8A7C2D706FE4E489058BADC963465DBB7" }, { "b" : "7F6130457000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B8DFF8E53D9F2B80C3C382E83EC17C828B536A39" }, { "b" : "7F61300C3000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "C78F2F16F8C2F9DB39CFCE348794BD92CA56499D" }, { "b" : "7F613156B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F8E59B70E469F3A924A268911FF8FD0C37E7460" }, { "b" : "7F612FE7F000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "b" : "7F612FB98000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "b" : "7F612F994000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "b" : "7F612F768000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "b" : "7F612F552000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F612F347000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "b" : "7F612F144000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F612EF2A000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F8B68F301C19BF06AF56B4B06E0A69F89D2C1F8D" }, { "b" : "7F612ED0B000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1337cb2] mongod(+0xF36BE9) [0x1336be9] mongod(+0xF373F2) [0x13373f2] libpthread.so.0(+0xF710) [0x7f6130466710] libc.so.6(gsignal+0x35) [0x7f61300f5625] libc.so.6(abort+0x175) [0x7f61300f6e05] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x12bea52] mongod(+0xCAF8D3) [0x10af8d3] mongod(__wt_eventv+0x42C) [0x1a9f62c] mongod(__wt_err+0x8D) [0x1a9faed] mongod(__wt_panic+0x24) [0x1a9fed4] mongod(__wt_block_extlist_read+0x6C) [0x19d18fc] mongod(__wt_block_extlist_read_avail+0x33) [0x19d1e73] mongod(__wt_block_checkpoint_load+0x3C5) [0x19cee15] mongod(+0x15D2EB9) [0x19d2eb9] mongod(__wt_btree_open+0xC7C) [0x19ef92c] mongod(__wt_conn_btree_open+0x140) [0x1a257c0] mongod(__wt_session_get_btree+0xE7) [0x1a9e357] mongod(__wt_session_get_btree+0x629) [0x1a9e899] mongod(__wt_session_get_btree_ckpt+0xAB) [0x1a9e9bb] mongod(__wt_curfile_open+0x218) [0x1a33db8] mongod(+0x169B515) [0x1a9b515] mongod(__wt_metadata_cursor_open+0x5F) [0x1a660ef] mongod(__wt_metadata_cursor+0x7E) [0x1a661ee] mongod(wiredtiger_open+0x1541) [0x1a223a1] mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb+0x46F) [0x109741f] mongod(+0xC93893) [0x1093893] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xfbad38] mongod(_ZN5mongo13initAndListenEi+0x3DD) [0x9970dd] mongod(main+0x15D) [0x99acbd] libc.so.6(__libc_start_main+0xFD) [0x7f61300e1d5d] mongod(+0x5937E9) [0x9937e9] ----- END BACKTRACE ----- 2017-12-18T21:17:21.823-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] MongoDB starting : pid=5384 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] modules: none 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] build environment: 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-18T21:17:21.836-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-18T21:17:21.873-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-18T21:17:21.873-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-18T21:17:22.403-0500 E STORAGE [initandlisten] WiredTiger (17) [1513649842:403841][5384:0x7f1ab2cfad40], WT_SESSION.create: /data/mongodb/sizeStorer.wt: handle-open: open: File exists 2017-12-18T21:17:22.403-0500 I STORAGE [initandlisten] WiredTiger unexpected file sizeStorer.wt found, renamed to sizeStorer.wt.1 2017-12-18T21:17:22.407-0500 I - [initandlisten] Fatal Assertion 34433 2017-12-18T21:17:22.407-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-18T21:17:44.104-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] MongoDB starting : pid=5397 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] modules: none 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] build environment: 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-18T21:17:44.116-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, repair: true, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-18T21:17:44.154-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-18T21:17:44.154-0500 I STORAGE [initandlisten] Detected WT journal files. Running recovery from last checkpoint. 2017-12-18T21:17:44.154-0500 I STORAGE [initandlisten] journal to nojournal transition config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-18T21:17:44.478-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),,log=(enabled=false), 2017-12-18T21:17:44.484-0500 I STORAGE [initandlisten] Repairing size cache 2017-12-18T21:17:44.485-0500 I STORAGE [initandlisten] Verify succeeded on uri table:sizeStorer. Not salvaging. 2017-12-18T21:17:44.485-0500 I STORAGE [initandlisten] Repairing catalog metadata 2017-12-18T21:17:44.488-0500 I STORAGE [initandlisten] Verify succeeded on uri table:_mdb_catalog. Not salvaging. 2017-12-18T21:17:44.505-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2017-12-18T21:17:44.505-0500 I CONTROL [initandlisten] 2017-12-18T21:17:44.505-0500 I CONTROL [initandlisten] 2017-12-18T21:17:44.505-0500 I CONTROL [initandlisten] ** WARNING: You are running in OpenVZ which can cause issues on versions of RHEL older than RHEL6. 2017-12-18T21:17:44.505-0500 I CONTROL [initandlisten] 2017-12-18T21:17:44.505-0500 I STORAGE [initandlisten] repairDatabase PLEASE_READ 2017-12-18T21:17:44.505-0500 I STORAGE [initandlisten] Repairing collection PLEASE_READ.PLEASE_READ 2017-12-18T21:17:44.505-0500 I STORAGE [initandlisten] Verify failed on uri table:collection-22-1184298026822592706. Running a salvage operation. 2017-12-18T21:17:44.505-0500 I - [initandlisten] Invariant failure rs.get() src/mongo/db/catalog/database.cpp 190 2017-12-18T21:17:44.505-0500 I - [initandlisten] ***aborting after invariant() failure 2017-12-18T21:17:44.516-0500 F - [initandlisten] Got signal: 6 (Aborted). 0x1337cb2 0x1336be9 0x13373f2 0x7f12bbd32710 0x7f12bb9c1625 0x7f12bb9c2e05 0x12be9bb 0xae4e3e 0xae6934 0xae97dd 0xe60393 0xe60d8d 0x99496a 0x997630 0x99acbd 0x7f12bb9add5d 0x9937e9 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F37CB2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F36BE9"},{"b":"400000","o":"F373F2"},{"b":"7F12BBD23000","o":"F710"},{"b":"7F12BB98F000","o":"32625","s":"gsignal"},{"b":"7F12BB98F000","o":"33E05","s":"abort"},{"b":"400000","o":"EBE9BB","s":"_ZN5mongo15invariantFailedEPKcS1_j"},{"b":"400000","o":"6E4E3E","s":"_ZN5mongo8Database30_getOrCreateCollectionInstanceEPNS_16OperationContextENS_10StringDataE"},{"b":"400000","o":"6E6934","s":"_ZN5mongo8DatabaseC1EPNS_16OperationContextENS_10StringDataEPNS_20DatabaseCatalogEntryE"},{"b":"400000","o":"6E97DD","s":"_ZN5mongo14DatabaseHolder6openDbEPNS_16OperationContextENS_10StringDataEPb"},{"b":"400000","o":"A60393"},{"b":"400000","o":"A60D8D","s":"_ZN5mongo14repairDatabaseEPNS_16OperationContextEPNS_13StorageEngineERKSsbb"},{"b":"400000","o":"59496A"},{"b":"400000","o":"597630","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"59ACBD","s":"main"},{"b":"7F12BB98F000","o":"1ED5D","s":"__libc_start_main"},{"b":"400000","o":"5937E9"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "2.6.32-042stab123.2", "version" : "#1 SMP Mon Apr 17 17:27:00 MSK 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "D6BB40ACB6CFEAA43C3A651DDD8E547FCFE19166" }, { "b" : "7FFFC73E5000", "elfType" : 3, "buildId" : "533CF5AD95A05EFC8DF9CE63034292313B26B1DD" }, { "b" : "7F12BCBCB000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F12BC7E6000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F12BC5DE000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "583411D8786F86A1D6B8741C502831E6122445A7" }, { "b" : "7F12BC3DA000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "454F8FC6CC6502C6401E5F9E221564D80665D277" }, { "b" : "7F12BC156000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "7D8E9374F4A4EA38A7C1E763F32240EA113E4208" }, { "b" : "7F12BBF40000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "BC7550A8A7C2D706FE4E489058BADC963465DBB7" }, { "b" : "7F12BBD23000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B8DFF8E53D9F2B80C3C382E83EC17C828B536A39" }, { "b" : "7F12BB98F000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "C78F2F16F8C2F9DB39CFCE348794BD92CA56499D" }, { "b" : "7F12BCE37000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F8E59B70E469F3A924A268911FF8FD0C37E7460" }, { "b" : "7F12BB74B000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "b" : "7F12BB464000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "b" : "7F12BB260000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "b" : "7F12BB034000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "b" : "7F12BAE1E000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F12BAC13000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "b" : "7F12BAA10000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F12BA7F6000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F8B68F301C19BF06AF56B4B06E0A69F89D2C1F8D" }, { "b" : "7F12BA5D7000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1337cb2] mongod(+0xF36BE9) [0x1336be9] mongod(+0xF373F2) [0x13373f2] libpthread.so.0(+0xF710) [0x7f12bbd32710] libc.so.6(gsignal+0x35) [0x7f12bb9c1625] libc.so.6(abort+0x175) [0x7f12bb9c2e05] mongod(_ZN5mongo15invariantFailedEPKcS1_j+0xCB) [0x12be9bb] mongod(_ZN5mongo8Database30_getOrCreateCollectionInstanceEPNS_16OperationContextENS_10StringDataE+0xFE) [0xae4e3e] mongod(_ZN5mongo8DatabaseC1EPNS_16OperationContextENS_10StringDataEPNS_20DatabaseCatalogEntryE+0x284) [0xae6934] mongod(_ZN5mongo14DatabaseHolder6openDbEPNS_16OperationContextENS_10StringDataEPb+0x18D) [0xae97dd] mongod(+0xA60393) [0xe60393] mongod(_ZN5mongo14repairDatabaseEPNS_16OperationContextEPNS_13StorageEngineERKSsbb+0x81D) [0xe60d8d] mongod(+0x59496A) [0x99496a] mongod(_ZN5mongo13initAndListenEi+0x930) [0x997630] mongod(main+0x15D) [0x99acbd] libc.so.6(__libc_start_main+0xFD) [0x7f12bb9add5d] mongod(+0x5937E9) [0x9937e9] ----- END BACKTRACE ----- 2017-12-18T21:19:40.066-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] MongoDB starting : pid=5428 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] modules: none 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] build environment: 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-18T21:19:40.075-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-18T21:19:40.109-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-18T21:19:40.109-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-18T21:19:40.136-0500 I - [initandlisten] Fatal Assertion 34433 2017-12-18T21:19:40.136-0500 I - [initandlisten] ***aborting after fassert() failure 2017-12-18T21:22:38.796-0500 I CONTROL [main] ***** SERVER RESTARTED ***** 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] MongoDB starting : pid=5446 port=27017 dbpath=/data/mongodb 64-bit host=localhost.localdomain 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] db version v3.2.7 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] allocator: tcmalloc 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] modules: none 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] build environment: 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] distmod: rhel62 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] distarch: x86_64 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] target_arch: x86_64 2017-12-18T21:22:38.807-0500 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { port: 27017 }, processManagement: { fork: true }, security: { authorization: "enabled" }, storage: { dbPath: "/data/mongodb" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb/log/mongodb.log" } } 2017-12-18T21:22:38.855-0500 I - [initandlisten] Detected data files in /data/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-12-18T21:22:38.856-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-12-18T21:22:38.881-0500 I - [initandlisten] Fatal Assertion 34433 2017-12-18T21:22:38.881-0500 I - [initandlisten] ***aborting after fassert() failure