Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-12113

Consider using custom skip function in tree walk to improve prefetch performance

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • StorEng - Refinement Pipeline

      Currently, the pre-fetching functionality will go through the regular tree walk function when identifying potential candidate pages for pre-fetching. This walks through all the pages in the b-tree in a sequential manner, and consequently may result in pre-fetch populating the pre-fetch queue with pages which are not useful to read (wasting effort and cache space).

      I'm not sure exactly how this would work, but maybe we could recursively call the _tree_walk_internal function with the _wt_btcur_skip_page skip function passed in when we identify that we are walking a tree using a session with pre-fetching enabled. The skip function would help avoid reading in unnecessary pages (e.g. pages with deleted contents/contents that are not visible).

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            monica.ng@mongodb.com Monica Ng
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: