2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] MongoDB starting : pid=5692 port=27017 dbpath=/var/lib/mongodb 64-bit host=net-pqm-p-mc-core 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] db version v3.2.11 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] git version: 009580ad490190ba33d1c6253ebd8d91808923e4 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.2l 25 May 2017 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] allocator: tcmalloc 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] modules: none 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] build environment: 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] distarch: x86_64 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] target_arch: x86_64 2018-02-09T08:02:05.329+0100 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb.log" } } 2018-02-09T08:02:05.364+0100 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2018-02-09T08:02:05.364+0100 I STORAGE [initandlisten] exception in initAndListen: 98 Unable to create/open lock file: /var/lib/mongodb/mongod.lock errno:13 Permission denied Is a mongod instance already running?, terminating 2018-02-09T08:02:05.364+0100 I CONTROL [initandlisten] dbexit: rc: 100 2018-02-09T08:03:18.046+0100 I CONTROL [main] ***** SERVER RESTARTED ***** 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] MongoDB starting : pid=5806 port=27017 dbpath=/var/lib/mongodb 64-bit host=net-pqm-p-mc-core 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] db version v3.2.11 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] git version: 009580ad490190ba33d1c6253ebd8d91808923e4 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.2l 25 May 2017 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] allocator: tcmalloc 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] modules: none 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] build environment: 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] distarch: x86_64 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] target_arch: x86_64 2018-02-09T08:03:18.054+0100 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { bindIp: "127.0.0.1" }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb.log" } } 2018-02-09T08:03:18.089+0100 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2018-02-09T08:03:18.089+0100 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=150G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2018-02-09T08:03:18.612+0100 E STORAGE [initandlisten] WiredTiger (0) [1518159798:612659][5806:0x7fb42d56ccc0], file:sizeStorer.wt, WT_SESSION.open_cursor: read checksum error for 4096B block at offset 12288: block header checksum of 4074814944 doesn't match expected checksum of 3842992612 2018-02-09T08:03:18.612+0100 E STORAGE [initandlisten] WiredTiger (0) [1518159798:612779][5806:0x7fb42d56ccc0], file:sizeStorer.wt, WT_SESSION.open_cursor: sizeStorer.wt: encountered an illegal file format or internal value 2018-02-09T08:03:18.612+0100 E STORAGE [initandlisten] WiredTiger (-31804) [1518159798:612809][5806:0x7fb42d56ccc0], file:sizeStorer.wt, WT_SESSION.open_cursor: the process must exit and restart: WT_PANIC: WiredTiger library panic 2018-02-09T08:03:18.612+0100 I - [initandlisten] Fatal Assertion 28558 2018-02-09T08:03:18.612+0100 I - [initandlisten] ***aborting after fassert() failure 2018-02-09T08:03:18.650+0100 F - [initandlisten] Got signal: 6 (Aborted). 0x56240394487a 0x5624039436d9 0x562403943fef 0x7fb42a0270c0 0x7fb429ca9fcf 0x7fb429cab3fa 0x5624038c0b52 0x56240365eee2 0x562402d44fc3 0x562402d450b3 0x562402d45311 0x562403ea1e4f 0x562403ea23ab 0x562403e9eaf5 0x562403ea3577 0x562403ebfddf 0x562403ef62bb 0x562403f84492 0x562403f84bc6 0x562403f850dc 0x562403f06159 0x562403f7f778 0x562403f204db 0x562403f7f514 0x562403f7fc87 0x56240365a7da 0x562403642469 0x56240363b5c4 0x562403529d8e 0x562402d925fb 0x562402d4617f 0x7fb429c972b1 0x562402d8c91a ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"56240275A000","o":"11EA87A","s":"_ZN5mongo15printStackTraceERSo"},{"b":"56240275A000","o":"11E96D9"},{"b":"56240275A000","o":"11E9FEF"},{"b":"7FB42A016000","o":"110C0"},{"b":"7FB429C77000","o":"32FCF","s":"gsignal"},{"b":"7FB429C77000","o":"343FA","s":"abort"},{"b":"56240275A000","o":"1166B52","s":"_ZN5mongo13fassertFailedEi"},{"b":"56240275A000","o":"F04EE2"},{"b":"56240275A000","o":"5EAFC3","s":"__wt_eventv"},{"b":"56240275A000","o":"5EB0B3","s":"__wt_err"},{"b":"56240275A000","o":"5EB311","s":"__wt_panic"},{"b":"56240275A000","o":"1747E4F","s":"__wt_block_extlist_read"},{"b":"56240275A000","o":"17483AB","s":"__wt_block_extlist_read_avail"},{"b":"56240275A000","o":"1744AF5","s":"__wt_block_checkpoint_load"},{"b":"56240275A000","o":"1749577"},{"b":"56240275A000","o":"1765DDF","s":"__wt_btree_open"},{"b":"56240275A000","o":"179C2BB","s":"__wt_conn_btree_open"},{"b":"56240275A000","o":"182A492","s":"__wt_session_get_btree"},{"b":"56240275A000","o":"182ABC6","s":"__wt_session_get_btree"},{"b":"56240275A000","o":"182B0DC","s":"__wt_session_get_btree_ckpt"},{"b":"56240275A000","o":"17AC159","s":"__wt_curfile_open"},{"b":"56240275A000","o":"1825778"},{"b":"56240275A000","o":"17C64DB","s":"__wt_curtable_open"},{"b":"56240275A000","o":"1825514"},{"b":"56240275A000","o":"1825C87"},{"b":"56240275A000","o":"F007DA","s":"_ZN5mongo20WiredTigerSizeStorerC1EP15__wt_connectionRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE"},{"b":"56240275A000","o":"EE8469","s":"_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_S8_mbbb"},{"b":"56240275A000","o":"EE15C4"},{"b":"56240275A000","o":"DCFD8E","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"56240275A000","o":"6385FB","s":"_ZN5mongo13initAndListenEi"},{"b":"56240275A000","o":"5EC17F","s":"main"},{"b":"7FB429C77000","o":"202B1","s":"__libc_start_main"},{"b":"56240275A000","o":"63291A","s":"_start"}],"processInfo":{ "mongodbVersion" : "3.2.11", "gitVersion" : "009580ad490190ba33d1c6253ebd8d91808923e4", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.9.0-4-amd64", "version" : "#1 SMP Debian 4.9.65-3+deb9u1 (2017-12-23)", "machine" : "x86_64" }, "somap" : [ { "b" : "56240275A000", "elfType" : 3, "buildId" : "D0CDC6CB216817166A72C99828603065503FAA7D" }, { "b" : "7FFFCF4FB000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "60DF8DD10E8262CC27215D214B4B4C95B339C393" }, { "b" : "7FB42D155000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "908B5A955D0A73FB8D31E0F927D0CDBA810CB300" }, { "b" : "7FB42CF4D000", "path" : "/usr/lib/x86_64-linux-gnu/libsnappy.so.1", "elfType" : 3, "buildId" : "2E75BB07FA335FA51E4A1F9EEFB8040CFF8639E1" }, { "b" : "7FB42CCCF000", "path" : "/usr/lib/x86_64-linux-gnu/libyaml-cpp.so.0.5", "elfType" : 3, "buildId" : "B658AFC5A5081D3BC01514CD135E11A630ACADF9" }, { "b" : "7FB42CA50000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_program_options.so.1.62.0", "elfType" : 3, "buildId" : "24B12C5DB7EB27CA6913E110036B6D501DE43D58" }, { "b" : "7FB42C837000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_filesystem.so.1.62.0", "elfType" : 3, "buildId" : "3A8C0229F2AA03F8A062D06D70C30A7C7F49ED6A" }, { "b" : "7FB42C60F000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_thread.so.1.62.0", "elfType" : 3, "buildId" : "559760FAD4E5057673E6A198DCA0682077CA73AD" }, { "b" : "7FB42C40B000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_system.so.1.62.0", "elfType" : 3, "buildId" : "9CEA3F7F5BCDA68EFA83A109C7C1C5C95EE5F9EE" }, { "b" : "7FB42C204000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_chrono.so.1.62.0", "elfType" : 3, "buildId" : "F7914F6A45BD6B1D843FF9B73651D7C85584D02F" }, { "b" : "7FB42BEEB000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_regex.so.1.62.0", "elfType" : 3, "buildId" : "3FF0F4ABFF7BE32CCA250E9592555231B0960605" }, { "b" : "7FB42BC9A000", "path" : "/usr/lib/x86_64-linux-gnu/libstemmer.so.0d", "elfType" : 3, "buildId" : "9CFDCA3EC241381801BA84204465310304FC7819" }, { "b" : "7FB42BA26000", "path" : "/usr/lib/libtcmalloc.so.4", "elfType" : 3, "buildId" : "63E43AB68BFBAD8631A9BC8549ADFA9BB8ED0DDC" }, { "b" : "7FB42B7B3000", "path" : "/lib/x86_64-linux-gnu/libpcre.so.3", "elfType" : 3, "buildId" : "1B72306EF00166FE1511D57140B50F5CE341170E" }, { "b" : "7FB42B5A9000", "path" : "/usr/lib/x86_64-linux-gnu/libpcrecpp.so.0", "elfType" : 3, "buildId" : "F9E20B1533BE511A4666D245232091723BD56BA9" }, { "b" : "7FB42B340000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.2", "elfType" : 3, "buildId" : "1630CCE76EEDD9125A54F54D251B37965488B8EA" }, { "b" : "7FB42AEDC000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.2", "elfType" : 3, "buildId" : "12EEE9EC13F435E4B1A3C53399D26E3EFFB84E56" }, { "b" : "7FB42ACD4000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "FE41526A83999F2FE9D0F8AADCD61D03A92CBB70" }, { "b" : "7FB42AAD0000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "6A5D98612129B8186F21E800AFDFAAA627082F46" }, { "b" : "7FB42A74E000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "9E79D92950117355FD694E178C26ADE013CAE38B" }, { "b" : "7FB42A44A000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "90DA054E12EA1A53EE0CBB5BB5E65F7069AEEE44" }, { "b" : "7FB42A233000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "036DAE71A7197C847FC5B720634642B922C74398" }, { "b" : "7FB42A016000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "968DF33F83963B559243653D74D27D89605BED02" }, { "b" : "7FB429C77000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "79450F6E36287865D093EA209B85A222209925FF" }, { "b" : "7FB42D36F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F150F33B150D6A81E26A425DD47D713D00F2D29" }, { "b" : "7FB4281FA000", "path" : "/usr/lib/x86_64-linux-gnu/libicudata.so.57", "elfType" : 3, "buildId" : "01887CCD8314CD2FD5075FC87BD7584537957A78" }, { "b" : "7FB427D80000", "path" : "/usr/lib/x86_64-linux-gnu/libicui18n.so.57", "elfType" : 3, "buildId" : "048D7FFB97F715DC3F00AC7CC0E602A6721C78A3" }, { "b" : "7FB4279D8000", "path" : "/usr/lib/x86_64-linux-gnu/libicuuc.so.57", "elfType" : 3, "buildId" : "1F229B3E3193711491516EF01A909ED6EEC56878" }, { "b" : "7FB4277BD000", "path" : "/usr/lib/x86_64-linux-gnu/libunwind.so.8", "elfType" : 3, "buildId" : "D018350F8DD20CC8574A21B2030049AB13E7CB1D" }, { "b" : "7FB427597000", "path" : "/lib/x86_64-linux-gnu/liblzma.so.5", "elfType" : 3, "buildId" : "D94951F95E154271AE7CF843CC9D6D67EA502F5D" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x3A) [0x56240394487a] mongod(+0x11E96D9) [0x5624039436d9] mongod(+0x11E9FEF) [0x562403943fef] libpthread.so.0(+0x110C0) [0x7fb42a0270c0] libc.so.6(gsignal+0xCF) [0x7fb429ca9fcf] libc.so.6(abort+0x16A) [0x7fb429cab3fa] mongod(_ZN5mongo13fassertFailedEi+0xA2) [0x5624038c0b52] mongod(+0xF04EE2) [0x56240365eee2] mongod(__wt_eventv+0x42B) [0x562402d44fc3] mongod(__wt_err+0xA0) [0x562402d450b3] mongod(__wt_panic+0x24) [0x562402d45311] mongod(__wt_block_extlist_read+0x8F) [0x562403ea1e4f] mongod(__wt_block_extlist_read_avail+0x2B) [0x562403ea23ab] mongod(__wt_block_checkpoint_load+0x265) [0x562403e9eaf5] mongod(+0x1749577) [0x562403ea3577] mongod(__wt_btree_open+0xBDF) [0x562403ebfddf] mongod(__wt_conn_btree_open+0x15B) [0x562403ef62bb] mongod(__wt_session_get_btree+0x102) [0x562403f84492] mongod(__wt_session_get_btree+0x836) [0x562403f84bc6] mongod(__wt_session_get_btree_ckpt+0x14C) [0x562403f850dc] mongod(__wt_curfile_open+0x179) [0x562403f06159] mongod(+0x1825778) [0x562403f7f778] mongod(__wt_curtable_open+0x85B) [0x562403f204db] mongod(+0x1825514) [0x562403f7f514] mongod(+0x1825C87) [0x562403f7fc87] mongod(_ZN5mongo20WiredTigerSizeStorerC1EP15__wt_connectionRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xEA) [0x56240365a7da] mongod(_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_S8_mbbb+0x1109) [0x562403642469] mongod(+0xEE15C4) [0x56240363b5c4] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x3CE) [0x562403529d8e] mongod(_ZN5mongo13initAndListenEi+0x48B) [0x562402d925fb] mongod(main+0x72F) [0x562402d4617f] libc.so.6(__libc_start_main+0xF1) [0x7fb429c972b1] mongod(_start+0x2A) [0x562402d8c91a] ----- END BACKTRACE -----