during final reduce in sharded environment, all results are loaded into an in memory map

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Done
    • Priority: Major - P3
    • 1.9.1
    • Affects Version/s: None
    • Component/s: MapReduce
    • None
    • ALL
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      the target mongod does parallelsort from all servers, getting the records sorted.
      It should just reduce and insert to temp collection.
      Instead the result is emitted, which puts it into a map.
      Then when all records are done, map is dumped to disk.
      May be very costly in cpu and mem for large jobs

            Assignee:
            Antoine Girbal (Inactive)
            Reporter:
            Antoine Girbal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: