Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-240

MongoDB 99% CPU usage while connector is executing

    • Type: Icon: Bug Bug
    • Resolution: Community Answered
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.3.2
    • Component/s: Performance
    • None
    • Environment:
      MongoDB 3.6

      Whenever results are inserted into MongoDB (and they're not more than 1000 Documents), our CPU spikes up to 99% for a decent amount of time, despite data being already dumped in the collection.

      Can't really provide much more than the WriteConfig we're using within, graphs wouldn't make much of a difference as you can only see the spike for half an hour more or less.

      May this be something in the config we're missing out?

      WriteConfig(databaseName = dbName,
                  collectionName = collection,
                  connectionString = Some(mongoURI))
      

       

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            eddyg Eddy G
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: