Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-319

Configuration improvements

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 10.0.0
    • Affects Version/s: None
    • Component/s: Configuration
    • None

      Ensure explicit options override spark conf options (even if the spark configuration includes specific usage configuration).

      // Regardless of spark config the collection to use here should be "myCollection".
      dfw.options("collection", "myCollection").save()
      

      Support short form options: dfw.options("collection", "myCollection").save() Should be accepted rather than requiring dfw.options("spark.mongodb.collection", "myCollection").

      Configuration errors should throw ConfigException rather than IllegalArgumentException or NumberFormatException.

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            ross@mongodb.com Ross Lawley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: