Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-8717

Flush files to S3 store and cache them locally to a local directory

    • Type: Icon: New Feature New Feature
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT11.0.0, 5.3.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • 5
    • Storage - Ra 2022-02-07

      The ticket involves the following:

      • Add a put object function to the AWS bucket conn to upload the given object to the configured bucket. Add a supporting unit test.
      • Implement WT_STORAGE_SOURCE.ss_flush for the tiered storage to move a file to the S3. The functionality will use the AWS put object to do so.
      • Implement WT_STORAGE_SOURCE.ss_flush_finish to move the local file to the cache.
      • Update the s3_store python test to flush the object to S3. Then use file exists (WT-8716) check to confirm that the file exists. (Test should also attempt to expire the cached object, i.e. delete it, then confirm the file still exists)
      • Add relevant statistics

            Assignee:
            ruby.chen@mongodb.com Ruby Chen
            Reporter:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: