Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-134

Provide library support for streams and structured streams

    • None
    • None
    • None
    • None
    • None
    • None

      Hi, is it possible that MongoDB Spark Connector supports Spark Structured Streaming?

      At the moment MongoDB Spark Connector 2.2.0 supports Spark Streaming but I can't find info about supporting Structured Streaming.

      Alternatively, as a workaround can you tell me how can I write the "Starting Streaming Queries" code in order to save the Streaming Dataframe?

      At the moment I have correctly inserted Structured Dataframes into MongoDB, but with no streaming.
      I think I should use foreach method, but at the moment I don't know how to implement it.

      Here's a little code examples inserting a Dataframe (done correctly) and Structured Streaming (I can't do it) into MongoDB :
      https://gist.github.com/rvilla87/4ff36b9b78dd65947ed761ebb54a7bb6

      Thanks in advance!

            Assignee:
            Unassigned Unassigned
            Reporter:
            rvilla Ruben Villacreces
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved:
              None
              None
              None
              None