2017-03-04T05:50:45.828-0500 E STORAGE [ApplyBatchFinalizerForJournal] WiredTiger error (28) [1488624645:828501][15745:0x7f7d863ca700], WT_SESSION.log_flush: /hostname/mongo/data/journal/WiredTigerLog.0000059170: handle-write: pwrite: failed to write 100992 bytes at offset 69279744: No space left on device
2017-03-04T05:50:45.864-0500 I - [ApplyBatchFinalizerForJournal] Invariant failure: s->log_flush(s, "sync=on") resulted in status UnknownError: 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_session_cache.cpp 229
2017-03-04T05:50:45.868-0500 I - [ApplyBatchFinalizerForJournal]
***aborting after invariant() failure
2017-03-04T05:50:45.955-0500 F - [ApplyBatchFinalizerForJournal] Got signal: 6 (Aborted).
0x7f7db4bf5be1 0x7f7db4bf4cd9 0x7f7db4bf51bd 0x7f7db23c47c0 0x7f7db2073b55 0x7f7db2075131 0x7f7db3e841ff 0x7f7db4900196 0x7f7db48fbb85 0x7f7db46d3fea 0x7f7db5668880 0x7f7db23bc7b6 0x7f7db21189cd
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"7F7DB3673000","o":"1582BE1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F7DB3673000","o":"1581CD9"},{"b":"7F7DB3673000","o":"15821BD"},{"b":"7F7DB23B5000","o":"F7C0"},{"b":"7F7DB2041000","o":"32B55","s":"gsignal"},{"b":"7F7DB2041000","o":"34131","s":"abort"},{"b":"7F7DB3673000","o":"8111FF","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj"},{"b":"7F7DB3673000","o":"128D196","s":"_ZN5mongo22WiredTigerSessionCache16waitUntilDurableEb"},{"b":"7F7DB3673000","o":"1288B85","s":"_ZN5mongo22WiredTigerRecoveryUnit16waitUntilDurableEv"},{"b":"7F7DB3673000","o":"1060FEA"},{"b":"7F7DB3673000","o":"1FF5880"},{"b":"7F7DB23B5000","o":"77B6"},{"b":"7F7DB2041000","o":"D79CD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.2", "gitVersion" : "3f76e40c105fc223b3e5aac3e20dcd026b83b38b", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.0.38-0.5-default", "version" : "#1 SMP Fri Aug 3 09:02:17 UTC 2012 (358029e)", "machine" : "x86_64" }, "somap" : [ { "b" : "7F7DB3673000", "elfType" : 3, "buildId" : "EEF048F2BC725C64C859DB42292814F165184232" }, { "b" : "7FFF38CFF000", "elfType" : 3, "buildId" : "F0DC8B581876594941DC196587ADA74A695C0C64" }, { "b" : "7F7DB31FE000", "path" : "/usr/lib64/libssl.so.0.9.8", "elfType" : 3, "buildId" : "E8358CAA116D347873309FD2B418A97CB5FD3938" }, { "b" : "7F7DB2E6E000", "path" : "/usr/lib64/libcrypto.so.0.9.8", "elfType" : 3, "buildId" : "921B613DF2F59194920EA4F00C63F4D22E9DC74A" }, { "b" : "7F7DB2C65000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "44612B93C19E6567318299411987B113D2387081" }, { "b" : "7F7DB2A61000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "3E4F6BFEE9FDF77CA975B77B8C325347D9228BB8" }, { "b" : "7F7DB27E8000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B10C3CAE031BA5A87E715C117A83CD3BEF83EBD2" }, { "b" : "7F7DB25D2000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "FE7C25BFB3E605F9D6C1CB00B3C5F96ED95BE6E5" }, { "b" : "7F7DB23B5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "368B7757BC9F9D7E2E93678C63CB3E5587A9934F" }, { "b" : "7F7DB2041000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "72E7B043935A2BD0B80D325F7F166A132CF37140" }, { "b" : "7F7DB3452000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "C81DE241A528795F8DBFDE0F0E0E236F9A6554E6" }, { "b" : "7F7DB1E2B000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "4C05D1EB180F9C02B81A0C559C813DADA91E0CA4" } ] }}
mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x7f7db4bf5be1]
mongod(+0x1581CD9) [0x7f7db4bf4cd9]
mongod(+0x15821BD) [0x7f7db4bf51bd]
libpthread.so.0(+0xF7C0) [0x7f7db23c47c0]
libc.so.6(gsignal+0x35) [0x7f7db2073b55]
libc.so.6(abort+0x181) [0x7f7db2075131]
mongod(_ZN5mongo25fassertFailedWithLocationEiPKcj+0x0) [0x7f7db3e841ff]
mongod(_ZN5mongo22WiredTigerSessionCache16waitUntilDurableEb+0x696) [0x7f7db4900196]
mongod(_ZN5mongo22WiredTigerRecoveryUnit16waitUntilDurableEv+0x15) [0x7f7db48fbb85]
mongod(+0x1060FEA) [0x7f7db46d3fea]
mongod(+0x1FF5880) [0x7f7db5668880]
libpthread.so.0(+0x77B6) [0x7f7db23bc7b6]
libc.so.6(clone+0x6D) [0x7f7db21189cd]
----- END BACKTRACE -----