Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10407

Support new compressor based on Intel IAA

    • Type: Icon: New Feature New Feature
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT11.2.0, 7.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Environment:
      Linux based OS

      Compression and decompress performance for mongodb is very important, a lot of mongodb deployment enabled compress/decompress. Meanwhile, Intel made an announcement on its accelerators called (IAA - in memory analytics accelerator) on next generation Xeon Scalable processor (code name Sapphire Rapids), _such as very high throughput compression and decompression combined with primitive analytic functions, as well as to provide highly-optimized SW fallback on other Intel CPUs.  Intel demonstrated IAA performance on this link: https://www.servethehome.com/intel-xeon-sapphire-rapids-shows-built-in-accelerators-at-innovation-2022/

      Here we've made an prototype based on Intel IAA to speedup compress/decompress in MongoDB, and proved good value prop when test with YCSB, much better compression compared with Snappy meanwhile better performance for insert (compress) and queries (decompress). 

      we want to upstream our code to Wiredtiger. pls feedback. 

      we could provide remote server for you to reproduce the performance. pls contact with us.

            Assignee:
            donald.anderson@mongodb.com Donald Anderson
            Reporter:
            jun.i.jin@intel.com Jun Jin
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: