2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] MongoDB starting : pid=2196 port=27012 dbpath=/var/lib/mongo 64-bit host=172.96.228.50.16clouds.com 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] db version v3.6.8 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] git version: 6bc9ed599c3fa164703346a22bad17e33fa913e4 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] allocator: tcmalloc 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] modules: none 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] build environment: 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] distmod: rhel62 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] distarch: x86_64 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] target_arch: x86_64 2019-05-31T12:03:59.954+0800 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "0.0.0.0", port: 27012 }, processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid", timeZoneInfo: "/usr/share/zoneinfo" }, storage: { dbPath: "/var/lib/mongo", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } 2019-05-31T12:03:59.954+0800 W - [initandlisten] Detected unclean shutdown - /var/lib/mongo/mongod.lock is not empty. 2019-05-31T12:03:59.956+0800 I - [initandlisten] Detected data files in /var/lib/mongo created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2019-05-31T12:03:59.956+0800 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2019-05-31T12:03:59.956+0800 I STORAGE [initandlisten] 2019-05-31T12:03:59.956+0800 I STORAGE [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine 2019-05-31T12:03:59.956+0800 I STORAGE [initandlisten] ** See http://dochub.mongodb.org/core/prodnotes-filesystem 2019-05-31T12:03:59.956+0800 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=256M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),cache_cursors=false,compatibility=(release="3.0",require_max="3.0"),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress), 2019-05-31T12:04:00.771+0800 E STORAGE [initandlisten] WiredTiger error (0) [1559275440:771226][2196:0x7f2602092a80], file:WiredTiger.wt, connection: WiredTiger.turtle: encountered an illegal file format or internal value: (__wt_turtle_read, 333) 2019-05-31T12:04:00.771+0800 E STORAGE [initandlisten] WiredTiger error (-31804) [1559275440:771378][2196:0x7f2602092a80], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2019-05-31T12:04:00.771+0800 F - [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 366 2019-05-31T12:04:00.771+0800 F - [initandlisten] ***aborting after fassert() failure 2019-05-31T12:04:00.818+0800 F - [initandlisten] Got signal: 6 (Aborted). 0x55dc99685b91 0x55dc99684da9 0x55dc9968528d 0x7f2600b657e0 0x7f26007f4495 0x7f26007f5c75 0x55dc97dd6120 0x55dc97ea41ce 0x55dc97f11b01 0x55dc97d72491 0x55dc97d727ba 0x55dc97ed7643 0x55dc97ed58d4 0x55dc97eb671a 0x55dc97f1037d 0x55dc97f1095a 0x55dc97f10bcc 0x55dc97f7e746 0x55dc97f0bf48 0x55dc97ed4e1e 0x55dc97ed4efb 0x55dc97eb534b 0x55dc97e87693 0x55dc97e6ba54 0x55dc98062537 0x55dc97d6e1ec 0x55dc97e4a91c 0x55dc97dd7de9 0x7f26007e0d1d 0x55dc97e3a2d1 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"55DC97441000","o":"2244B91","s":"_ZN5mongo15printStackTraceERSo"},{"b":"55DC97441000","o":"2243DA9"},{"b":"55DC97441000","o":"224428D"},{"b":"7F2600B56000","o":"F7E0"},{"b":"7F26007C2000","o":"32495","s":"gsignal"},{"b":"7F26007C2000","o":"33C75","s":"abort"},{"b":"55DC97441000","o":"995120","s":"_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"},{"b":"55DC97441000","o":"A631CE"},{"b":"55DC97441000","o":"AD0B01"},{"b":"55DC97441000","o":"931491","s":"__wt_err"},{"b":"55DC97441000","o":"9317BA","s":"__wt_panic"},{"b":"55DC97441000","o":"A96643","s":"__wt_turtle_read"},{"b":"55DC97441000","o":"A948D4","s":"__wt_metadata_search"},{"b":"55DC97441000","o":"A7571A","s":"__wt_conn_dhandle_open"},{"b":"55DC97441000","o":"ACF37D","s":"__wt_session_get_dhandle"},{"b":"55DC97441000","o":"ACF95A","s":"__wt_session_get_dhandle"},{"b":"55DC97441000","o":"ACFBCC","s":"__wt_session_get_btree_ckpt"},{"b":"55DC97441000","o":"B3D746","s":"__wt_curfile_open"},{"b":"55DC97441000","o":"ACAF48"},{"b":"55DC97441000","o":"A93E1E","s":"__wt_metadata_cursor_open"},{"b":"55DC97441000","o":"A93EFB","s":"__wt_metadata_cursor"},{"b":"55DC97441000","o":"A7434B","s":"wiredtiger_open"},{"b":"55DC97441000","o":"A46693","s":"_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb"},{"b":"55DC97441000","o":"A2AA54"},{"b":"55DC97441000","o":"C21537","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"55DC97441000","o":"92D1EC"},{"b":"55DC97441000","o":"A0991C","s":"_ZN5mongo11mongoDbMainEiPPcS1_"},{"b":"55DC97441000","o":"996DE9","s":"main"},{"b":"7F26007C2000","o":"1ED1D","s":"__libc_start_main"},{"b":"55DC97441000","o":"9F92D1"}],"processInfo":{ "mongodbVersion" : "3.6.8", "gitVersion" : "6bc9ed599c3fa164703346a22bad17e33fa913e4", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.15.7-1.el6.elrepo.x86_64", "version" : "#1 SMP Wed Feb 28 15:17:53 EST 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "55DC97441000", "elfType" : 3, "buildId" : "2FBEFD95BCF3C64D4D4BB6199F97EE6AE1D7F56F" }, { "b" : "7FFC53975000", "elfType" : 3, "buildId" : "67CDC476C3E281BF7606FC8B36E6ECC42E141BAA" }, { "b" : "7F2601C6A000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "F0BE1166EDCFFB2422B940D601A1BBD89352D80F" }, { "b" : "7F2601885000", "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "CBDA444A7109874C5350AE9CEEF3F82F749B347F" }, { "b" : "7F2601619000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "BECFB85A8BC084042D5BF2BA9E66325CE798B659" }, { "b" : "7F2601415000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "1F7E85410384392BC51FA7324961719A10125F31" }, { "b" : "7F260120D000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "FDF3A36FFFE08375456D59DA959EAB2FC30B6186" }, { "b" : "7F2600F89000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "8A852AC42F0B64F0F30C760EBBCFA3FE4A228F12" }, { "b" : "7F2600D73000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "EDC925E58FE28DCA536993EB13179C739F1E6566" }, { "b" : "7F2600B56000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "85104ECFE42C606B31C2D0D0D2E5DACD3286A341" }, { "b" : "7F26007C2000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "814F2290D172521A3FD8581389E3E78A4A182379" }, { "b" : "7F2601E84000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "1CC2165E019D43F71FDE0A47AF9F4C8EB5E51963" }, { "b" : "7F26005AC000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "b" : "7F2600368000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9A737F8BF10FC99C37CC404D3FC188F6E11FEDD9" }, { "b" : "7F2600081000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "8D3D6E28DF6EB3752642A7031AAC17D39EA4265D" }, { "b" : "7F25FFE7D000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "57F77704A7F1F4E3689D028D3F9ADD4E77486EC9" }, { "b" : "7F25FFC51000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "CC89B4C8CDCCD32BA610BC72784DC3B7E9BD9E19" }, { "b" : "7F25FFA46000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "E0C522C589F775C324330BE09CE67DC83950A213" }, { "b" : "7F25FF843000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "b" : "7F25FF624000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x55dc99685b91] mongod(+0x2243DA9) [0x55dc99684da9] mongod(+0x224428D) [0x55dc9968528d] libpthread.so.0(+0xF7E0) [0x7f2600b657e0] libc.so.6(gsignal+0x35) [0x7f26007f4495] libc.so.6(abort+0x175) [0x7f26007f5c75] mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x55dc97dd6120] mongod(+0xA631CE) [0x55dc97ea41ce] mongod(+0xAD0B01) [0x55dc97f11b01] mongod(__wt_err+0x9D) [0x55dc97d72491] mongod(__wt_panic+0x33) [0x55dc97d727ba] mongod(__wt_turtle_read+0x343) [0x55dc97ed7643] mongod(__wt_metadata_search+0x1C4) [0x55dc97ed58d4] mongod(__wt_conn_dhandle_open+0x8A) [0x55dc97eb671a] mongod(__wt_session_get_dhandle+0xED) [0x55dc97f1037d] mongod(__wt_session_get_dhandle+0x6CA) [0x55dc97f1095a] mongod(__wt_session_get_btree_ckpt+0x14C) [0x55dc97f10bcc] mongod(__wt_curfile_open+0x56) [0x55dc97f7e746] mongod(+0xACAF48) [0x55dc97f0bf48] mongod(__wt_metadata_cursor_open+0x6E) [0x55dc97ed4e1e] mongod(__wt_metadata_cursor+0x4B) [0x55dc97ed4efb] mongod(wiredtiger_open+0x1A0B) [0x55dc97eb534b] mongod(_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb+0x8B3) [0x55dc97e87693] mongod(+0xA2AA54) [0x55dc97e6ba54] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x637) [0x55dc98062537] mongod(+0x92D1EC) [0x55dc97d6e1ec] mongod(_ZN5mongo11mongoDbMainEiPPcS1_+0x86C) [0x55dc97e4a91c] mongod(main+0x9) [0x55dc97dd7de9] libc.so.6(__libc_start_main+0xFD) [0x7f26007e0d1d] mongod(+0x9F92D1) [0x55dc97e3a2d1] ----- END BACKTRACE -----