Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-374

Implement an error handler to address specific scenarios

    • Type: Icon: New Feature New Feature
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 1.12.0
    • Affects Version/s: 1.12.0
    • Component/s: Sink
    • None
    • Needed
    • Hide

      There is support for a new value for mongo sink connectors

      mongo.errors.tolerance=data 
      

      When this value is set, the sink connector will only tolerate data errors and fail for any other errors. This error tolerance is to be used when it is not acceptable to have DLQ documents when the sink connector can not communicate to the database.

      Show
      There is support for a new value for mongo sink connectors mongo.errors.tolerance=data  When this value is set, the sink connector will only tolerate data errors and fail for any other errors. This error tolerance is to be used when it is not acceptable to have DLQ documents when the sink connector can not communicate to the database.

      There is currently a mongo.errors.tolerance flag which doesn't work as some customers expect.  There is a need to be able to instruct the connector to fail under certain circumstances versus proceed.  For example, it should be possible to fail the connector if the network connectivity to mongodb fails and in other cases throw data into the DLQ for malformed data for example.  This ability to fine tune the behavior of errors is the feature request.

       

            Assignee:
            jagadish.nallapaneni@mongodb.com Jagadish Nallapaneni
            Reporter:
            robert.walters@mongodb.com Robert Walters (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: