Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-378

Support configurable startAtOperationTime in spark streams

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 10.2.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Needed
    • Hide

      1. What would you like to communicate to the user about this feature?

      * Added `change.stream.startup.mode` that specifies how the connector should start up when there is no offset available.
        - `latest` is the default value.
        - `timestamp` requires `change.stream.startup.mode.timestamp.start.at.operation.time` to be configured.
           Accepts either:
             - an Integer representing seconds since epoch
             - an ISO-8601 format date time with one second precision
             - an extended JSON BsonTimestamp.
      

      2. Would you like the user to see examples of the syntax and/or executable code and its output?

      Configuration options examples are:

      The following timestamp examples are all the same:

      • 30
      • 1970-01-01T00:00:30Z
      • {"$timestamp":
        Unknown macro: {"t"}

        }

      3. Which versions of the driver/connector does this apply to?

      10.2.0

      Show
      1. What would you like to communicate to the user about this feature? * Added `change.stream.startup.mode` that specifies how the connector should start up when there is no offset available. - `latest` is the default value. - `timestamp` requires `change.stream.startup.mode.timestamp.start.at.operation.time` to be configured. Accepts either: - an Integer representing seconds since epoch - an ISO-8601 format date time with one second precision - an extended JSON BsonTimestamp. 2. Would you like the user to see examples of the syntax and/or executable code and its output? Configuration options examples are: The following timestamp examples are all the same: 30 1970-01-01T00:00:30Z {"$timestamp": Unknown macro: {"t"} } 3. Which versions of the driver/connector does this apply to? 10.2.0

          Assignee:
          ross@mongodb.com Ross Lawley
          Reporter:
          ross@mongodb.com Ross Lawley
          Votes:
          0 Vote for this issue
          Watchers:
          5 Start watching this issue

            Created:
            Updated:
            Resolved: