Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-89109

Enhance the DLQ messages to include source, offset info, processorName

    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 8.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • Atlas Streams
    • Fully Compatible
    • Sprint 46

      In order for the customer to be able to successfully re-process DLQ messages we would like some additional information added when DLQ documents are written. 

      {
        doc: {
          _ts: ISODate("2023-01-01T00:00:00Z"),
          _stream_meta: {
             source.offset: 42,      // kafka offset/partition info
             source.partition: 1,
             ...
          },
          a: 1
        },
        errInfo: {
           reason: "Input document arrived late."
        },
        processorName: "foo123"   // processor name that originated this message
        instanceName: "mySP01".   // instance name that originated this message
        // Other fields for the specific error. The missedWindowStartTimes is an example for late arriving documents.
        missedWindowStartTimes: [ISODate("2023-01-01T00:00:00Z")] 
      } 

       

            Assignee:
            matthew.normyle@mongodb.com Matthew Normyle
            Reporter:
            kenny.gorman@mongodb.com Kenny Gorman
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: