-
Type: Build Failure
-
Resolution: Duplicate
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Block Cache
-
Storage Engines
-
1
-
3
-
2024-07-09 - Nyan Cat
format-failure-configs-test on ubuntu2004
Host: i-031cdd3b332d23b67
Project: wiredtiger-mongo-v7.0
Commit: 2bf083be
Task Logs:
format-failure-configs-test task_log
Logs:
0x2afa640:transaction state dump 0x2afa640:current ID: 3 0x2afa640:last running ID: 3 0x2afa640:metadata_pinned ID: 3 0x2afa640:oldest ID: 3 0x2afa640:durable timestamp: (0, 0) 0x2afa640:oldest timestamp: (0, 0) 0x2afa640:pinned timestamp: (0, 0) 0x2afa640:stable timestamp: (0, 0) 0x2afa640:has_durable_timestamp: no 0x2afa640:has_oldest_timestamp: no 0x2afa640:has_pinned_timestamp: no 0x2afa640:has_stable_timestamp: no 0x2afa640:oldest_is_pinned: no 0x2afa640:stable_is_pinned: no 0x2afa640:checkpoint running: no 0x2afa640:checkpoint generation: 2 0x2afa640:checkpoint pinned ID: 0 0x2afa640:checkpoint txn ID: 0 0x2afa640:session count: 13 0x2afa640:Transaction state of active sessions: 0x2afa640:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= 0x2afa640:cache dump 0x2afa640:cache full: yes 0x2afa640:cache clean check: yes (221.339%) 0x2afa640:cache dirty check: no (0.000%) 0x2afa640:cache updates check: no (0.000%) [1718153273:941834][2955:0x7fdb218a4700], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_server, 487: Cache stuck for too long, giving up: Connection timed out [1718153273:942424][2955:0x7fdb218a4700], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 344: cache eviction thread error: Connection timed out [1718153273:942434][2955:0x7fdb218a4700], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 344: the process must exit and restart: WT_PANIC: WiredTiger library panic [1718153273:942442][2955:0x7fdb218a4700], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library 0x2afa640:file:T00002.wt(<live>) eviction disabled at open: 0x2afa640: handle opened exclusively, cannot walk tree, skipping 0x2afa640:file:T00001.wt(<live>): 0x2afa640:internal: 2 pages, 45.92 KB, 2/0 clean/dirty pages, 45.92/0.00 clean / dirty KB, 22.96 KB max page, 0.00 KB max dirty page 0x2afa640:leaf: 1 pages, 86.35 KB, 1/0 clean/dirty pages, 86.35 /0.00 /0.00 clean/dirty/updates KB, 86.35 KB max page, 0.00 KB max dirty page 0x2afa640:file:WiredTigerHS.wt(<live>) eviction disabled at open: 0x2afa640:internal: 1 pages, 0.27 KB, 1/0 clean/dirty pages, 0.27/0.00 clean / dirty KB, 0.27 KB max page, 0.00 KB max dirty page 0x2afa640:leaf: 0 pages 0x2afa640:file:WiredTiger.wt(<live>): 0x2afa640:internal: 1 pages, 0.61 KB, 0/1 clean/dirty pages, 0.00/0.61 clean / dirty KB, 0.61 KB max page, 0.61 KB max dirty page 0x2afa640:leaf: 0 pages 0x2afa640:cache dump: total found: 0.14 MB vs tracked inuse 635.33 MB 0x2afa640:total dirty bytes: 0.00 MB vs tracked dirty 635.20 MB
format-failure-configs-test task_log
Logs:
[1718153707:974442][7047:0x7f950992bc40], t, file:F00001, WT_SESSION.salvage: [WT_VERB_EXTENSION][ERROR]: snappy error: snappy_decompress: SNAPPY_INVALID_INPUT: 1 [1718153738:733962][7047:0x7f950992bc40], t, file:T00002.wt, WT_SESSION.salvage: [WT_VERB_EXTENSION][ERROR]: snappy error: snappy_decompress: SNAPPY_INVALID_INPUT: 1 [1718157161:813529][12271:0x7f886a542c40], t, file:T00004.wt, WT_SESSION.salvage: [WT_VERB_EXTENSION][ERROR]: zlib error: inflate: buffer error: -5 [1718157573:541031][17233:0x7f82807c0c40], t, file:T00002.wt, WT_SESSION.salvage: [WT_VERB_EXTENSION][ERROR]: zstd error: ZSTD_decompress: Corrupted block detected
format-failure-configs-test task_log
Logs:
#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #1 0x00007fdb24c16859 in __GI_abort () at abort.c:79 #2 0x00007fdb25008e18 in __wt_abort (session=session@entry=0x2afa640) at /data/mci/d7ca3737f49e1f49e9577a90ff083002/wiredtiger/src/os_common/os_abort.c:30 #3 0x00007fdb2509755a in __wt_panic_func (session=session@entry=0x2afa640, error=error@entry=110, func=func@entry=0x7fdb250f1df0 <__PRETTY_FUNCTION__.22> "__wt_evict_thread_run", line=line@entry=344, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0x7fdb250f1ba4 "cache eviction thread error") at /data/mci/d7ca3737f49e1f49e9577a90ff083002/wiredtiger/src/support/err.c:570 #4 0x00007fdb24fc1fcb in __wt_evict_thread_run (session=0x2afa640, thread=0x2634460) at /data/mci/d7ca3737f49e1f49e9577a90ff083002/wiredtiger/src/evict/evict_lru.c:344 #5 0x00007fdb250ae3d1 in __thread_run (arg=0x2634460) at /data/mci/d7ca3737f49e1f49e9577a90ff083002/wiredtiger/src/support/thread_group.c:31 #6 0x00007fdb24e1b609 in start_thread (arg=<optimized out>) at pthread_create.c:477 #7 0x00007fdb24d13353 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
- duplicates
-
WT-5447 bulk-load and salvage can use excessive amounts of cache and cause cache stuck
- Backlog