Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-431

Upgrade mongo driver version to at least 4.11 in the new spark connector version

XMLWordPrintableJSON

    • Type: Icon: New Feature New Feature
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 10.4.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Java Drivers
    • Needed
    • Hide

      1. What would you like to communicate to the user about this feature?

      Just to let them know it now uses the 5.1.x version of the java driver.

      Show
      1. What would you like to communicate to the user about this feature? Just to let them know it now uses the 5.1.x version of the java driver.

      current version of the mongo-spark-connector uses the mongo driver version 4.8.2, which does not support providing socks5 proxy configuration

      ```log

      processing-1  | To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyport'.
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyhost'.
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyport'.
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyhost'.
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyport'.
      processing-1  | 24/06/16 18:27:53 WARN uri: Connection string contains unsupported option 'proxyhost'.

      ```

      I would happy to have the driver updated in the new connector version 10.4.0

       

      thank you

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            korzuninva@gmail.com Victor Korzunin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: