Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10868

Cache stuck for too long error (wt4803_history_store_abort) MSAN

    • Type: Icon: Build Failure Build Failure
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • 2023-05-02 StorEng Bug Bash

      make-check-test on ubuntu2004-msan

      Host: i-0703f9635ac31e84b
      Project: wiredtiger
      Commit: 57bcfe46

      Task Logs:

      make-check-test task_log

      Logs:

       88/105 Test  #91: test_wt4803_history_store_abort ..................Subprocess aborted***Exception: 329.96 sec
      

      logs

      make-check-test task_log

      Logs:

      [1680274427:488981][52200:0x7f948b33c700], eviction-server: [WT_VERB_DEFAULT][ERROR]: int __evict_server(WT_SESSION_IMPL *, _Bool *), 487: Cache stuck for too long, giving up: Connection timed out: Connection timed out
      
      

      logs

      make-check-test task_log

      Logs:

      transaction state dump
      current ID: 2735
      last running ID: 2735
      metadata_pinned ID: 2005
      oldest ID: 2005
      durable timestamp: (0, 0)
      oldest timestamp: (0, 0)
      pinned timestamp: (0, 0)
      stable timestamp: (0, 0)
      has_durable_timestamp: no
      has_oldest_timestamp: no
      has_pinned_timestamp: no
      has_stable_timestamp: no
      oldest_is_pinned: no
      stable_is_pinned: no
      checkpoint running: no
      checkpoint generation: 1
      checkpoint pinned ID: 0
      checkpoint txn ID: 0
      session count: 16
      Transaction state of active sessions:
      ID: 0, pinned ID: 2005, metadata pinned ID: 0, name: EMPTY
      transaction id: 0, mod count: 0, snap min: 2005, snap max: 2005, snapshot count: 0, commit_timestamp: (0, 0), durable_timestamp: (0, 0), first_commit_timestamp: (0, 0), prepare_timestamp: (0, 0), pinned_durable_timestamp: (0, 0), read_timestamp: (0, 0), checkpoint LSN: [0][0], full checkpoint: false, rollback reason: , flags: 0x00001008, isolation: WT_ISO_SNAPSHOT
      =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      cache dump
      cache full: no
      cache clean check: no (60.823%)
      cache dirty check: no (10.802%)
      cache updates check: yes (10.801%)
      file:test_wt4803_history_store_abort.wt(<live>):
      internal: 1 pages, 24.79 KB, 0/1 clean/dirty pages, 0.00/24.79 clean / dirty KB, 24.79 KB max page, 24.79 KB max dirty page
      leaf: 42 pages, 5131.67 KB, 41/1 clean/dirty pages, 10.78 /5120.89 /5120.64 clean/dirty/updates KB, 5120.89 KB max page, 5120.89 KB max dirty page
      file:WiredTigerHS.wt(<live>):
      internal: 1 pages, 122.11 KB, 0/1 clean/dirty pages, 0.00/122.11 clean / dirty KB, 122.11 KB max page, 122.11 KB max dirty page
      leaf: 23 pages, 23555.68 KB, 23/0 clean/dirty pages, 23555.68 /0.00 /0.00 clean/dirty/updates KB, 1024.16 KB max page, 0.00 KB max dirty page
      file:WiredTiger.wt(<live>):
      internal: 1 pages, 0.56 KB, 1/0 clean/dirty pages, 0.56/0.00 clean / dirty KB, 0.56 KB max page, 0.00 KB max dirty page
      leaf: 0 pages
      cache dump: total found: 30.41 MB vs tracked inuse 28.16 MB
      total dirty bytes: 5.14 MB vs tracked dirty 5.14 MB
      

      logs

      make-check-test task_log

      Logs:

      [1680274427:495697][52200:0x7f948b33c700], eviction-server: [WT_VERB_DEFAULT][ERROR]: int __wt_evict_thread_run(WT_SESSION_IMPL *, WT_THREAD *), 344: cache eviction thread error: Connection timed out: Connection timed out
      [1680274427:495727][52200:0x7f948b33c700], eviction-server: [WT_VERB_DEFAULT][ERROR]: int __wt_evict_thread_run(WT_SESSION_IMPL *, WT_THREAD *), 344: the process must exit and restart: WT_PANIC: WiredTiger library panic: WT_PANIC: WiredTiger library panic
      [1680274427:495751][52200:0x7f948b33c700], eviction-server: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 28: aborting WiredTiger library: Successful return: 0
      

      logs

      make-check-test task_log

      Logs:

      test_wt4803_history_store_abort: FAILED: void test_hs_workload(TEST_OPTS *, const char *)/185: status == 0
      
      

      logs

      make-check-test task_log

      Logs:

      test_wt4803_history_store_abort: process aborting
      WiredTiger Error: void __wt_abort(WT_SESSION_IMPL *), 28: aborting WiredTiger library
      

      logs

      make-check-test task_log

      Logs:

      The following tests FAILED:
      
      

      logs

      make-check-test task_log

      Logs:

      #3  0x00007f948dd51f87 in __wt_panic_func (session=<optimized out>, error=110, func=0x7f948e3734c5 "int __wt_evict_thread_run(WT_SESSION_IMPL *, WT_THREAD *)", line=344, category=WT_VERB_DEFAULT, fmt=0x0) at /data/mci/28087bae9fa53e672ff1bbffaeac3ab3/wiredtiger/src/support/err.c:570
      
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: