2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] MongoDB starting : pid=57216 port=27017 dbpath=/var/lib/mongodb 64-bit host=server2016 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] db version v3.2.7 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] git version: 4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1k 8 Jan 2015 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] allocator: tcmalloc 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] modules: none 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] build environment: 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] distmod: debian71 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] distarch: x86_64 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] target_arch: x86_64 2017-01-24T16:04:34.533+0800 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "10.10.11.1", port: 27017 }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } 2017-01-24T16:04:34.550+0800 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2017-01-24T16:04:34.550+0800 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=150G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2017-01-24T16:04:34.713+0800 E STORAGE [initandlisten] WiredTiger (2) [1485245074:713666][57216:0x7f06b6e6ecc0], txn-recover: /var/lib/mongodb/journal/WiredTigerLog.0000000089: handle-open: open: No such file or directory 2017-01-24T16:04:34.713+0800 E STORAGE [initandlisten] WiredTiger (2) [1485245074:713960][57216:0x7f06b6e6ecc0], WT_CURSOR.search: /var/lib/mongodb/journal/WiredTigerLog.0000000089: handle-open: open: No such file or directory 2017-01-24T16:04:34.714+0800 E STORAGE [initandlisten] WiredTiger (2) [1485245074:714292][57216:0x7f06b6e6ecc0], txn-recover: /var/lib/mongodb/journal/WiredTigerLog.0000000089: handle-open: open: No such file or directory 2017-01-24T16:04:34.845+0800 E STORAGE [initandlisten] WiredTiger (0) [1485245074:845598][57216:0x7f06b6e6ecc0], file:sizeStorer.wt, WT_SESSION.open_cursor: read checksum error for 4096B block at offset 12288: block header checksum of 1667591276 doesn't match expected checksum of 2364547298 2017-01-24T16:04:34.845+0800 E STORAGE [initandlisten] WiredTiger (0) [1485245074:845641][57216:0x7f06b6e6ecc0], file:sizeStorer.wt, WT_SESSION.open_cursor: sizeStorer.wt: encountered an illegal file format or internal value 2017-01-24T16:04:34.845+0800 E STORAGE [initandlisten] WiredTiger (-31804) [1485245074:845650][57216:0x7f06b6e6ecc0], file:sizeStorer.wt, WT_SESSION.open_cursor: the process must exit and restart: WT_PANIC: WiredTiger library panic 2017-01-24T16:04:34.845+0800 I - [initandlisten] Fatal Assertion 28558 2017-01-24T16:04:34.845+0800 I - [initandlisten] ***aborting after fassert() failure 2017-01-24T16:04:34.860+0800 F - [initandlisten] Got signal: 6 (Aborted). 0x13043c2 0x13032e9 0x1303af2 0x7f06b5ad48d0 0x7f06b574f067 0x7f06b5750448 0x128a3b2 0x1072af3 0x1a7938c 0x1a7984d 0x1a79c34 0x19aa04c 0x19aa5c3 0x19a7555 0x19ab609 0x19c807c 0x19ff3d0 0x1a780b7 0x1a785f9 0x1a7871b 0x1a0da08 0x1a75275 0x1a23e63 0x1a750f9 0x1a75689 0x106e9e3 0x105a847 0x1056a43 0xf7c258 0x949b1d 0x94d71d 0x7f06b573bb45 0x946279 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F043C2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F032E9"},{"b":"400000","o":"F03AF2"},{"b":"7F06B5AC5000","o":"F8D0"},{"b":"7F06B571A000","o":"35067","s":"gsignal"},{"b":"7F06B571A000","o":"36448","s":"abort"},{"b":"400000","o":"E8A3B2","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"C72AF3"},{"b":"400000","o":"167938C","s":"__wt_eventv"},{"b":"400000","o":"167984D","s":"__wt_err"},{"b":"400000","o":"1679C34","s":"__wt_panic"},{"b":"400000","o":"15AA04C","s":"__wt_block_extlist_read"},{"b":"400000","o":"15AA5C3","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"15A7555","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"15AB609"},{"b":"400000","o":"15C807C","s":"__wt_btree_open"},{"b":"400000","o":"15FF3D0","s":"__wt_conn_btree_open"},{"b":"400000","o":"16780B7","s":"__wt_session_get_btree"},{"b":"400000","o":"16785F9","s":"__wt_session_get_btree"},{"b":"400000","o":"167871B","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"160DA08","s":"__wt_curfile_open"},{"b":"400000","o":"1675275"},{"b":"400000","o":"1623E63","s":"__wt_curtable_open"},{"b":"400000","o":"16750F9"},{"b":"400000","o":"1675689"},{"b":"400000","o":"C6E9E3","s":"_ZN5mongo20WiredTigerSizeStorerC1EP15__wt_connectionRKSs"},{"b":"400000","o":"C5A847","s":"_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb"},{"b":"400000","o":"C56A43"},{"b":"400000","o":"B7C258","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"549B1D","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"54D71D","s":"main"},{"b":"7F06B571A000","o":"21B45","s":"__libc_start_main"},{"b":"400000","o":"546279"}],"processInfo":{ "mongodbVersion" : "3.2.7", "gitVersion" : "4249c1d2b5999ebbf1fdf3bc0e0e3b3ff5c0aaf2", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.2.8-1-pve", "version" : "#1 SMP Fri Feb 26 16:37:36 CET 2016", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "290161E49FF073654474160230025167BE1051AF" }, { "b" : "7FFDBE7B8000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "4ED8155828FD1463E11C3B9FE028EBD51D0E2BC7" }, { "b" : "7F06B6A01000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "D4D0BB3CFDADD313B42F7171FF0DFA7B99273EF9" }, { "b" : "7F06B6605000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "14E70DB0187BF481D59A09563A52C46B2856A6D5" }, { "b" : "7F06B63FD000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "C96926159E07B6128EFEC30001EF8AD3D24672DD" }, { "b" : "7F06B61F9000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "1FDE060F62834E445210B73CD25C7ABDF905B542" }, { "b" : "7F06B5EF8000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "53024C3BBDBA1F0CBCC01D6A80FA2CBDFE33EB42" }, { "b" : "7F06B5CE2000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "D5FB04F64B3DAEA6D6B68B5E8B9D4D2BC1A6E1FC" }, { "b" : "7F06B5AC5000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "424D19435BCBB4D6E67DC19FD6EA95AC08B09237" }, { "b" : "7F06B571A000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "2BBA9D358BAC63FF81597767B5BC229316BD12E0" }, { "b" : "7F06B6C61000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "486275655F9C95F0B45F9E4CEA1A448DB59625D8" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x13043c2] mongod(+0xF032E9) [0x13032e9] mongod(+0xF03AF2) [0x1303af2] libpthread.so.0(+0xF8D0) [0x7f06b5ad48d0] libc.so.6(gsignal+0x37) [0x7f06b574f067] libc.so.6(abort+0x148) [0x7f06b5750448] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128a3b2] mongod(+0xC72AF3) [0x1072af3] mongod(__wt_eventv+0x42C) [0x1a7938c] mongod(__wt_err+0x8D) [0x1a7984d] mongod(__wt_panic+0x24) [0x1a79c34] mongod(__wt_block_extlist_read+0x6C) [0x19aa04c] mongod(__wt_block_extlist_read_avail+0x33) [0x19aa5c3] mongod(__wt_block_checkpoint_load+0x3C5) [0x19a7555] mongod(+0x15AB609) [0x19ab609] mongod(__wt_btree_open+0xC7C) [0x19c807c] mongod(__wt_conn_btree_open+0x140) [0x19ff3d0] mongod(__wt_session_get_btree+0xE7) [0x1a780b7] mongod(__wt_session_get_btree+0x629) [0x1a785f9] mongod(__wt_session_get_btree_ckpt+0xAB) [0x1a7871b] mongod(__wt_curfile_open+0x218) [0x1a0da08] mongod(+0x1675275) [0x1a75275] mongod(__wt_curtable_open+0x393) [0x1a23e63] mongod(+0x16750F9) [0x1a750f9] mongod(+0x1675689) [0x1a75689] mongod(_ZN5mongo20WiredTigerSizeStorerC1EP15__wt_connectionRKSs+0xD3) [0x106e9e3] mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_S2_mbbb+0x6E7) [0x105a847] mongod(+0xC56A43) [0x1056a43] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x598) [0xf7c258] mongod(_ZN5mongo13initAndListenEi+0x3DD) [0x949b1d] mongod(main+0x15D) [0x94d71d] libc.so.6(__libc_start_main+0xF5) [0x7f06b573bb45] mongod(+0x546279) [0x946279] ----- END BACKTRACE -----