Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-9072

Invalid use of LSM with block-based incremental backup

    • Type: Icon: Build Failure Build Failure
    • Resolution: Won't Fix
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: LSM
    • 3
    • StorEng - Defined Pipeline

      coverage-report on code-statistics

      Host: i-05abb3681c8b8069a
      Project: wiredtiger
      Commit: a47bf12a

      Task Logs:

      coverage-report task_log

      Logs:

      larity=16384
      block_cache=0
      block_cache.cache_on_checkpoint=1
      block_cache.cache_on_writes=1
      block_cache.size=63
      btree.compression=zlib
      btree.dictionary=0
      btree.huffman_value=0
      btree.internal_key_truncation=1
      btree.internal_page_max=15
      btree.key_max=68
      btree.key_min=14
      btree.leaf_page_max=14
      btree.memory_page_max=3
      btree.prefix_len=0
      btree.prefix_compression=1
      btree.prefix_compression_min=0
      btree.reverse=0
      btree.split_pct=100
      btree.value_max=2141
      btree.value_min=13
      cache=25227
      cache.evict_max=3
      cache.minimum=20
      checkpoint=1
      checkpoint.log_size=108
      checkpoint.wait=59
      disk.checksum=on
      disk.data_extend=0
      disk.direct_io=0
      disk.encryption=none
      disk.firstfit=0
      disk.mmap=1
      disk.mmap_all=0
      format.abort=0
      format.independent_thread_rng=0
      format.major_timeout=0
      import=0
      logging=0
      logging.compression=none
      logging.file_max=244021
      logging.prealloc=1
      logging.remove=1
      lsm.auto_throttle=1
      lsm.bloom=1
      lsm.bloom_bit_count=23
      lsm.bloom_hash_count=8
      lsm.bloom_oldest=0
      lsm.chunk_size=9
      lsm.merge_max=6
      lsm.worker_threads=3
      ops.alter=0
      ops.compaction=0
      ops.hs_cursor=0
      ops.pct.delete=14
      ops.pct.insert=16
      ops.pct.modify=4
      ops.pct.read=39
      ops.pct.write=27
      ops.prepare=0
      ops.random_cursor=0
      ops.salvage=1
      ops.truncate=1
      ops.verify=1
      quiet=1
      runs.in_memory=0
      runs.ops=0
      runs.rows=1000000
      runs.source=lsm
      runs.threads=10
      runs.timer=15
      runs.type=row-store
      runs.verify_failure_dump=0
      statistics=0
      statistics.server=0
      stress.aggressive_sweep=0
      stress.checkpoint=0
      stress.checkpoint_reserved_txnid_delay=0
      stress.checkpoint_prepare=0
      stress.failpoint_hs_delete_key_from_ts=0
      stress.hs_checkpoint_delay=0
      stress.hs_search=0
      stress.hs_sweep=0
      stress.split_1=0
      stress.split_2=0
      stress.split_3=0
      stress.split_4=0
      stress.split_5=0
      stress.split_6=0
      stress.split_7=0
      transaction.implicit=74
      transaction.timestamps=0
      wiredtiger.config=off
      wiredtiger.rwlock=1
      wiredtiger.leak_memory=0
      t: FAILED: session.open_cursor: backup: Operation not supported
      t: run FAILED
      t: process aborting
      WiredTiger Error: __wt_abort, 28: aborting WiredTiger library
      ############################################
      #  RUN PARAMETERS: V3
      ############################################
      assert.read_timestamp=0
      assert.write_timestamp=0
      backup=1
      backup.incremental=block
      backup.incr_granularity=16384
      block_cache=0
      block_cache.cache_on_checkpoint=1
      block_cache.cache_on_writes=1
      block_cache.size=63
      btree.compression=zlib
      btree.dictionary=0
      btree.huffman_value=0
      btree.internal_key_truncation=1
      btree.internal_page_max=15
      btree.key_max=68
      btree.key_min=14
      btree.leaf_page_max=14
      btree.memory_page_max=3
      btree.prefix_len=0
      btree.prefix_compression=1
      btree.prefix_compression_min=0
      btree.reverse=0
      btree.split_pct=100
      btree.value_max=2141
      btree.value_min=13
      cache=25227
      cache.evict_max=3
      cache.minimum=20
      checkpoint=1
      checkpoint.log_size=108
      checkpoint.wait=59
      disk.checksum=on
      disk.data_extend=0
      disk.direct_io=0
      disk.encryption=none
      disk.firstfit=0
      disk.mmap=1
      disk.mmap_all=0
      format.abort=0
      format.independent_thread_rng=0
      format.major_timeout=0
      import=0
      logging=0
      logging.compression=none
      logging.file_max=244021
      logging.prealloc=1
      logging.remove=1
      lsm.auto_throttle=1
      lsm.bloom=1
      lsm.bloom_bit_count=23
      lsm.bloom_hash_count=8
      lsm.bloom_oldest=0
      lsm.chunk_size=9
      lsm.merge_max=6
      lsm.worker_threads=3
      ops.alter=0
      ops.compaction=0
      ops.hs_cursor=0
      ops.pct.delete=14
      ops.pct.insert=16
      ops.pct.modify=4
      ops.pct.read=39
      ops.pct.write=27
      ops.prepare=0
      ops.random_cursor=0
      ops.salvage=1
      ops.truncate=1
      ops.verify=1
      quiet=1
      runs.in_memory=0
      runs.ops=0
      runs.rows=1000000
      runs.source=lsm
      runs.threads=10
      runs.timer=15
      runs.type=row-store
      runs.verify_failure_dump=0
      statistics=0
      statistics.server=0
      stress.aggressive_sweep=0
      stress.checkpoint=0
      stress.checkpoint_reserved_txnid_delay=0
      stress.checkpoint_prepare=0
      stress.failpoint_hs_delete_key_from_ts=0
      stress.hs_checkpoint_delay=0
      stress.hs_search=0
      stress.hs_sweep=0
      stress.split_1=0
      stress.split_2=0
      stress.split_3=0
      stress.split_4=0
      stress.split_5=0
      stress.split_6=0
      stress.split_7=0
      transaction.implicit=74
      transaction.timestamps=0
      wiredtiger.config=off
      wiredtiger.rwlock=1
      wiredtiger.leak_memory=0
      Aborted (core dumped)
      Finished 'shell.exec' in "format test" in 8.328280158s
      Running command 'shell.exec' in "format test" (step 12 of 18)
      for i in $(seq 1); do
        ./t -c ../../../test/format/CONFIG.coverage file_type=row compression=lz4 prefix_compression=1 leaf_page_max=9 internal_page_max=9 key_min=256 value_min=256 || ( [ -f RUNDIR/CONFIG ] && cat RUNDIR/CONFIG ) 2>&1
      done
      t: process 1791972 running
      t: successful run completed (995 seconds)
      Finished 'shell.exec' in "format test" in 16m34.658051704s
      Running command 'shell.exec' in "format test" (step 13 of 18)
      for i in $(seq 1); do
        ./t -c ../../../test/format/CONFIG.coverage file_type=var compression=snappy checksum=uncompressed dictionary=1 repeat_data_pct=10 || ( [ -f RUNDIR/CONFIG ] && cat RUNDIR/CONFIG ) 2>&1
      done
      t: process 1792101 running
      t: successful run completed (893 seconds)
      Finished 'shell.exec' in "format test" in 14m52.692832215s
      Running command 'shell.exec' in "format test" (step 14 of 18)
      for i in $(seq 1); do
        ./t -c ../../../test/format/CONFIG.coverage file_type=var leaf_page_max=9 internal_page_max=9 value_min=256 || ( [ -f RUNDIR/CONFIG ] && cat RUNDIR/CONFIG ) 2>&1
      done
      t: process 1792215 running
      t: successful run completed (1085 seconds)
      Finished 'shell.exec' in "format test" in 18m5.266945764s
      Running command 'shell.exec' in "format test" (step 15 of 18)
      for i in $(seq 1); do
        ./t -c ../../../test/format/CONFIG.coverage file_type=fix || ( [ -f RUNDIR/CONFIG ] && cat RUNDIR/CONFIG ) 2>&1
      done
      t: process 1792423 running
      t: successful run completed (891 seconds)
      Finished 'shell.exec' in "format test" in 14m50.777832757s
      Running command 'shell.exec' (step 16 of 18)
      Using base prefix '/usr'
      New python executable in /data/mci/49a8f3b00f7eb6650ec36e9f718620e0/wiredtiger/cmake_build/venv/bin/python3
      Also creating executable in /data/mci/49a8f3b00f7eb6650ec36e9f718620e0/wiredtiger/cmake_build/venv/bin/python
      virtualenv -p python3 venv
      /usr/local/lib/python2.7/dist-packages/virtualenv.py:1047: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
        import imp
      Installing setuptools, pip, wheel...done.
      Running virtualenv with interpreter /usr/bin/python3
      source venv/bin/activate
      # This file must be used with "source bin/activate" *from bash*
      # you cannot run it directly
      deactivate () {
          unset -f pydoc >/dev/null 2>&1
          # reset old environment variables
          # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
          if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
              PATH="$_OLD_VIRTUAL_PATH"
              export PATH
              unset _OLD_VIRTUAL_PATH
          fi
          if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
              PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
              export PYTHONHOME
              unset _OLD_VIRTUAL_PYTHONHOME
          fi
          # This should detect bash and zsh, which have a hash command that must
          # be called to get it to forget past commands.  Without forgetting
          # past commands the $PATH changes we made may not be respected
          if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
              hash -r 2>/dev/null
          fi
          if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
              PS1="$_OLD_VIRTUAL_PS1"
              export PS1
              unset _OLD_VIRTUAL_PS1
          fi
          unset VIRTUAL_ENV
          if [ ! "${1-}" = "nondestructive" ] ; then
          # Self destruct!
              unset -f deactivate
          fi
      }
      # unset irrelevant variables
      deactivate nondestructive
      VIRTUAL_ENV="/data/mci/49a8f3b00f7eb6650ec36e9f718620e0/wiredtiger/cmake_build/venv"
      export VIRTUAL_ENV
      _OLD_VIRTUAL_PATH="$PATH"
      PATH="$VIRTUAL_ENV/bin:$PATH"
      export PATH
      # unset PYTHONHOME if set
      if ! [ -z "${PYTHONHOME+_}" ] ; then
          _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
          unset PYTHONHOME
      fi
      if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
          _OLD_VIRTUAL_PS1="$PS1"
          if [ "x" != x ] ; then
              PS1="$PS1"
          else
              PS1="(`basename \"$VIRTUAL_ENV\"`) $PS1"
          fi
          export PS1
      fi
      # Make sure to unalias pydoc if it's already there
      alias pydoc 2>/dev/null >/dev/null && unalias pydoc
      pydoc () {
          python -m pydoc "$@"
      }
      # This should detect bash and zsh, which have a hash command that must
      # be called to get it to forget past commands.  Without forgetting
      # past commands the $PATH changes we made may not be respected
      if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
          hash -r 2>/dev/null
      fi
      Looking in indexes: https://artifactory.corp.mongodb.com/artifactory/api/pypi/pypi/simple, https://pypi.org/simple
      Collecting gcovr
        Downloading gcovr-5.1-py2.py3-none-any.whl (76 kB)
           ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.3/76.3 KB 9.8 MB/s eta 0:00:00
      Collecting pygments
        Downloading Pygments-2.11.2-py3-none-any.whl (1.1 MB)
           ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 13.2 MB/s eta 0:00:00
      Collecting jinja2
        Downloading Jinja2-3.1.1-py3-none-any.whl (132 kB)
           ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.6/132.6 KB 19.5 MB/s eta 0:00:00
      Collecting lxml
        Downloading lxml-4.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (6.9 MB)
           ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.9/6.9 MB 31.5 MB/s eta 0:00:00
      Collecting MarkupSafe>=2.0
        Downloading MarkupSafe-2.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
      Installing collected packages: pygments, MarkupSafe, lxml, jinja2, gcovr
      Successfully installed MarkupSafe-2.1.1 gcovr-5.1 jinja2-3.1.1 lxml-4.8.0 pygments-2.11.2
      pip3 install gcovr
      mkdir -p ../coverage_report
      GCOV=/opt/mongodbtoolchain/v3/bin/gcov gcovr -r .. -f ../src -e '.*/bt_(debug|dump|misc|salvage|vrfy).*' -e '.*/(log|progress|verify_build|strerror|env_msg|err_file|cur_config|os_abort)\..*' -e '.*_stat\..*' -e 'bench' -e 'examples' -e 'test' -e 'ext' -e 'dist'
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_code_statistics_coverage_report_a47bf12a717db87f20d9df44a14ce72560bdf79f_22_04_04_03_42_41/0?type=T#L70013
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: