Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-2992

Speed up importing csv files with mongoimport

    • Type: Icon: Investigation Investigation
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: mongoimport
    • None
    • 1,075

      Importing a CSV file with mongoimport is very slow, processing at around 4 MB/sec.
      The database is capable of more than 400 MB/sec. Parsing CSV files should be possible even faster than that. Using multiple threads is not really a solution as it is often desirable to maintain insert order, and it also should be independent of making the single-threaded case perform reasonably well.

            Assignee:
            Unassigned Unassigned
            Reporter:
            geert.bosch@mongodb.com Geert Bosch
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: