Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-3582

Cache stuck full of internal pages

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 3.6.0-rc0, WT3.0.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage 2017-10-23

      Failure at :
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-sanitizer-old-branches/488/

      test/format config that gets stuck:

      ############################################
      #  RUN PARAMETERS
      ############################################
      abort=0
      alter=0
      auto_throttle=1
      backups=0
      bitcnt=1
      bloom=1
      bloom_bit_count=21
      bloom_hash_count=12
      bloom_oldest=1
      cache=10
      checkpoints=1
      checksum=uncompressed
      chunk_size=10
      compaction=0
      compression=zlib
      data_extend=1
      data_source=file
      delete_pct=0
      dictionary=0
      direct_io=0
      encryption=none
      evict_max=5
      file_type=row-store
      firstfit=0
      huffman_key=0
      huffman_value=0
      in_memory=0
      insert_pct=85
      internal_key_truncation=1
      internal_page_max=9
      isolation=read-committed
      key_gap=1
      key_max=256
      key_min=256
      leaf_page_max=9
      leak_memory=0
      logging=1
      logging_archive=0
      logging_compression=zlib
      logging_prealloc=0
      long_running_txn=0
      lsm_worker_threads=4
      merge_max=14
      mmap=1
      ops=100000
      prefix_compression=1
      prefix_compression_min=6
      quiet=1
      read_pct=3
      rebalance=1
      repeat_data_pct=10
      reverse=1
      rows=100000
      runs=1
      salvage=1
      split_pct=87
      statistics=0
      statistics_server=0
      threads=2
      timer=20
      transaction-frequency=93
      value_max=3726
      value_min=256
      verify=1
      wiredtiger_config=
      write_pct=12
      ############################################
      

      cache dump:

      0x633000001b80:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x633000001b80:transaction state dump
      0x633000001b80:current ID: 204468
      0x633000001b80:last running ID: 204468
      0x633000001b80:oldest ID: 204468
      0x633000001b80:oldest named snapshot ID: 0
      0x633000001b80:checkpoint running? no
      0x633000001b80:checkpoint generation: 7
      0x633000001b80:checkpoint pinned ID: 0
      0x633000001b80:checkpoint txn ID: 0
      0x633000001b80:session count: 14
      0x633000001b80:Transaction state of active sessions:
      0x633000001b80:ID:      0, mod count: 0, pinned ID: 204468, snap min: 204468, snap max: 204468, metadata pinned ID: 0, flags: 0x00000048, name: WT_CURSOR.insert, isolation: WT_ISO_READ_COMMITTED
      0x633000001b80:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x633000001b80:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x633000001b80:cache dump
      0x633000001b80:file:wt(checkpoint=WiredTigerCheckpoint.9):
      0x633000001b80:internal: 32 pages, 0MB, 32/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x633000001b80:file:wt(<live>):
      0x633000001b80:internal: 682 pages, 8MB, 10/672 clean/dirty pages, 0/8 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x633000001b80:file:WiredTigerLAS.wt(<live>):
      0x633000001b80:internal: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x633000001b80:file:WiredTiger.wt(<live>):
      0x633000001b80:internal: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x633000001b80:cache dump: total found: 9MB vs tracked inuse 9MB
      0x633000001b80:total dirty bytes: 8MB
      0x633000001b80:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      [1505202606:83839][11535:0x7f915e6c9700], t, eviction-server: cache eviction thread error: Connection timed out
      [1505202606:83856][11535:0x7f915e6c9700], t, eviction-server: the process must exit and restart: WT_PANIC: WiredTiger library panic
      [1505202606:83870][11535:0x7f915e6c9700], t, eviction-server: aborting WiredTiger library
      /tmp/jenkins7470662266065827407.sh: line 29: 11535 Aborted                 nice ./t file_type=row data_source=file leaf_page_max=9 internal_page_max=9 key_min=256 value_min=256 cache=10
      

            Assignee:
            michael.cahill@mongodb.com Michael Cahill (Inactive)
            Reporter:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: