Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-379

mongoimport tries to insert too large document and fails with TCP connection closed error.

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • 3.0.0-rc6
    • Affects Version/s: 2.8.0-rc0
    • Component/s: mongoimport
    • None
    • Environment:
      linux x64, ubuntu
    • Not Needed

      Steps.

      1. Start import of a large JSON document, its a single document of size ~180 MB.
      2. mongoimport gives the following error on Command Line.

      /mongodb-linux-x86_64-2.8.0-rc0/bin$ ./mongoimport ../../samplegeo/citylots.json --db sample --collection citylots --batchSize=1
2014-11-15T13:27:58.937+1100    connected to: localhost
2014-11-15T13:28:13.533+1100    error inserting documents: write tcp 127.0.0.1:27017: broken pipe
2014-11-15T13:28:13.533+1100    imported 1 document

      3. Server log shows the following message.

      2014-11-15T13:27:58.936+1100 I NETWORK  [initandlisten] connection accepted from 127.0.0.1:48823 #13 (5 connections now open)
2014-11-15T13:28:13.532+1100 I NETWORK  [conn13] recv(): message len 170889227 is invalid. Min 16 Max: 48000000
2014-11-15T13:28:13.532+1100 I NETWORK  [conn13] end connection 127.0.0.1:48823 (4 connections now open)

      I understand that document larger than 16MB cannot be inserted into the database, but the messages are showing irrelevant information(difficult to debug with wrong message)

        1. citylots_original.json.gz
          21.85 MB

            Assignee:
            mikeo@mongodb.com Michael O'Brien
            Reporter:
            Jagsir jagsir [X]
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: