Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-18967

Failed to start MongoD after hitting out of disk space

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: WiredTiger
    • ALL
    • Hide

      1) hammer.mongo - cap-collection load

      Show
      1) hammer.mongo - cap-collection load

      Environment:

      db version v3.1.5-pre-
      Single node mongod on a physical machine (windows)

      Mongod terminated with no disk space error in unexpected scenario (on running stress w/ cap collection).

      Since I didn’t expect this to happen, I tried to review the collection stat() information and restart mongod (no incoming traffic to the machine)

      I received the error below, which get me to a situation that I can't restart the service in order to perform any maintenance w/o an external drive and etc.

      2015-06-14T07:07:19.575-0400 W -        [initandlisten] Detected unclean shutdown - d:\data\db1\mongod.lock is not empty.
2015-06-14T07:07:19.575-0400 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
2015-06-14T07:07:19.575-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2015-06-14T07:07:25.737-0400 E STORAGE  [initandlisten] WiredTiger (-28888) [1434280045:737588][4744:140704081122080], WT_SESSION.checkpoint: journal/WiredTigerLog.0000002677 SetEndOfFile error: There is not enough space on the disk.

ÔT ½
2015-06-14T07:07:25.737-0400 E STORAGE  [initandlisten] WiredTiger (0) [1434280045:737588][4744:140704081122080], WT_SESSION.close: scratch buffer allocated and never discarded
2015-06-14T07:07:27.186-0400 E STORAGE  [initandlisten] WiredTiger (-28888) [1434280047:186672][4744:140704081122080], eviction-server: journal/WiredTigerLog.0000002677 SetEndOfFile error: There is not enough space on the disk.

¹¥
2015-06-14T07:07:27.191-0400 I -        [initandlisten] Assertion: 28595:-28888: There is not enough space on the disk.


2015-06-14T07:07:27.193-0400 I STORAGE  [initandlisten] exception in initAndListen: 28595 -28888: There is not enough space on the disk.

, terminating
2015-06-14T07:07:27.193-0400 I CONTROL  [initandlisten] dbexit:  rc: 100

            Assignee:
            Unassigned Unassigned
            Reporter:
            eitan.klein Eitan Klein
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: