Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-36970

Mongodb failed to start after a disk 100% full problem

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.2.6
    • Component/s: None
    • Linux

      I encountered a similar problem as this post:

      https://jira.mongodb.org/browse/SERVER-26237

      and want to know if anybody can help on that. 

      The mongodb starting log is listed:

      2018-08-31T11:32:42.803+0800 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net:

      { port: 27017 }

      , replication: { oplogSizeMB: 1024, replSetName: "workaioplog" }, security: { authorization: "enabled" }, storage: { dbPath: "/var/lib/mongodb", journal:

      { enabled: false }

      }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } }
      2018-08-31T11:32:42.835+0800 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
      2018-08-31T11:32:42.848+0800 I STORAGE [initandlisten] Detected WT journal files. Running recovery from last checkpoint.
      2018-08-31T11:32:42.848+0800 I STORAGE [initandlisten] journal to nojournal transition config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2018-08-31T11:32:42.885+0800 E STORAGE [initandlisten] WiredTiger (0) [1535686362:885029][899:0x7f49f1f32cc0], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 61440: block header checksum of 3027734606 doesn't match expected checksum of 2157011047
      2018-08-31T11:32:42.885+0800 E STORAGE [initandlisten] WiredTiger (0) [1535686362:885098][899:0x7f49f1f32cc0], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value
      2018-08-31T11:32:42.885+0800 E STORAGE [initandlisten] WiredTiger (-31804) [1535686362:885129][899:0x7f49f1f32cc0], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2018-08-31T11:32:42.885+0800 I - [initandlisten] Fatal Assertion 28558
      2018-08-31T11:32:42.885+0800 I - [initandlisten]

      ***aborting after fassert() failure

      Can anyone help to generate the repair file for me? I attached the files probably you need in the following:

       

       

        1. logfile.tar.gz
          90 kB
          Xing Fang
        2. repair-attempt-36970.tar.gz
          90 kB
          Nick Brewer

            Assignee:
            nick.brewer Nick Brewer
            Reporter:
            lorrie Xing Fang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: