Flush files to S3 store and cache them locally to a local directory

XMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Fixed
    • Priority: Major - P3
    • WT11.0.0, 5.3.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage - Ra 2022-02-07
    • 5

      The ticket involves the following:

      • Add a put object function to the AWS bucket conn to upload the given object to the configured bucket. Add a supporting unit test.
      • Implement WT_STORAGE_SOURCE.ss_flush for the tiered storage to move a file to the S3. The functionality will use the AWS put object to do so.
      • Implement WT_STORAGE_SOURCE.ss_flush_finish to move the local file to the cache.
      • Update the s3_store python test to flush the object to S3. Then use file exists (WT-8716) check to confirm that the file exists. (Test should also attempt to expire the cached object, i.e. delete it, then confirm the file still exists)
      • Add relevant statistics

            Assignee:
            Ruby Chen
            Reporter:
            Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: