Calculate average document size if not available from storageStats

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Fixed
    • Priority: Unknown
    • 10.5.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Java Drivers
    • Needed
    • Hide

      1. What would you like to communicate to the user about this feature?
      Added partitioner support for using spark with Atlas Data Federation

      2. Would you like the user to see examples of the syntax and/or executable code and its output? n/a

      3. Which versions of the driver/connector does this apply to?
      10.5.0

      Show
      1. What would you like to communicate to the user about this feature? Added partitioner support for using spark with Atlas Data Federation 2. Would you like the user to see examples of the syntax and/or executable code and its output? n/a 3. Which versions of the driver/connector does this apply to? 10.5.0
    • None
    • None
    • None
    • None
    • None
    • None

      Product Use Case

      Atlas Data Federation (ADF) does not include avgObjSize in the collStats. User can compute this though via size / count.

      User Impact

      It would allow the use of Spark and ADF with the default partitioners.

      User has provided a PR: https://github.com/mongodb/mongo-spark/pull/132
      This could be used as the base to switch calculations based on the presence of avgObjSize

            Assignee:
            Ross Lawley
            Reporter:
            Ross Lawley
            None
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: