Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-11122

moveChunk fails in sharding/hash_basic.js on slow hosts

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • 2.5.3
    • Affects Version/s: None
    • Component/s: Sharding
    • Environment:
      Windows 32-bit
    • Windows
    • Hide

      Recurring failure in Windows 32-bit build since 10/9

      Show
      Recurring failure in Windows 32-bit build since 10/9

      http://buildlogs.mongodb.org/mci_0.9_windows_32/builds/426/test/sharding_0/hash_basic.js

      m30000| 2013-10-10T12:10:45.720+0000 [conn7] moveChunk request accepted at version 4|1||52569943902bd79d28635866
      m30000| 2013-10-10T12:10:45.721+0000 [conn7] moveChunk number of documents: 250
      m30000| 2013-10-10T12:10:45.724+0000 [conn7] warning: moveChunk failed to engage TO-shard in the data transfer: migrate already in progress
      m30000| 2013-10-10T12:10:45.724+0000 [conn7] MigrateFromStatus::done About to acquire global write lock to exit critical section
      m30000| 2013-10-10T12:10:45.724+0000 [conn7] MigrateFromStatus::done Global lock acquired
      m30001| 2013-10-10T12:10:45.722+0000 [conn5] run command admin.$cmd { _recvChunkStart: "test.user", from: "localhost:30000", min:

      { x: -4611686018427387902 }

      , max:

      { x: 0 }

      , shardKeyPattern:

      { x: "hashed" }

      , configServer: "localhost:30000", secondaryThrottle: false }
      m30001| 2013-10-10T12:10:45.722+0000 [conn5] command admin.$cmd command: { _recvChunkStart: "test.user", from: "localhost:30000", min:

      { x: -4611686018427387902 }

      , max:

      { x: 0 }

      , shardKeyPattern:

      { x: "hashed" }

      , configServer: "localhost:30000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 reslen:77 0ms
      m30000| 2013-10-10T12:10:45.724+0000 [conn13] running multiple plans
      m30000| 2013-10-10T12:10:45.725+0000 [conn13] update config.locks query:

      { _id: "test.user", ts: ObjectId('52569945cd80328228514786') }

      update: { $set:

      { state: 0 }

      } nscanned:1 nupdated:1 fastmod:1 keyUpdates:0 locks(micros) w:238 0ms
      m30000| 2013-10-10T12:10:45.725+0000 [conn13] run command admin.$cmd

      { getlasterror: 1 }

      m30000| 2013-10-10T12:10:45.725+0000 [conn13] command admin.$cmd command:

      { getlasterror: 1 }

      ntoreturn:1 keyUpdates:0 reslen:85 0ms
      m30000| 2013-10-10T12:10:45.725+0000 [conn7] distributed lock 'test.user/EC2AMAZ-ZVRDQB5:30000:1381407044:41' unlocked.
      m30000| 2013-10-10T12:10:45.725+0000 [conn7] about to log metadata event: { _id: "EC2AMAZ-ZVRDQB5-2013-10-10T12:10:45-52569945cd80328228514788", server: "EC2AMAZ-ZVRDQB5", clientAddr: "127.0.0.1:63707", time: new Date(1381407045725), what: "moveChunk.from", ns: "test.user", details: { min:

      { x: -4611686018427387902 }

      , max:

      { x: 0 }

      , step 1 of 6: 0, step 2 of 6: 7, note: "aborted" } }
      m30000| 2013-10-10T12:10:45.725+0000 [conn7] command admin.$cmd command: { moveChunk: "test.user", from: "localhost:30000", to: "localhost:30001", fromShard: "shard0000", toShard: "shard0001", min:

      { x: -4611686018427387902 }

      , max:

      { x: 0 }

      , maxChunkSizeBytes: 52428800, shardId: "test.user-x_-4611686018427387902", configdb: "localhost:30000", secondaryThrottle: false, waitForDelete: true } ntoreturn:1 keyUpdates:0 locks(micros) W:39 r:853 w:6 reslen:199 12ms
      m30000| 2013-10-10T12:10:45.726+0000 [conn10] insert config.changelog ninserted:1 keyUpdates:0 locks(micros) w:85 0ms
      m30999| 2013-10-10T12:10:45.726+0000 [conn1] moveChunk result: { cause:

      { ok: 0.0, errmsg: "migrate already in progress" }

      , ok: 0.0, errmsg: "moveChunk failed to engage TO-shard in the data transfer: migrate already in progress" }
      m30000| 2013-10-10T12:10:45.726+0000 [conn3] query config.chunks query: { query:

      { ns: "test.user" }

      , orderby:

      { lastmod: -1 }

      } ntoreturn:1 ntoskip:0 nscanned:1 keyUpdates:0 locks(micros) r:145 nreturned:1 reslen:191 0ms
      assert failed : Cmd failed: {
      "cause" : {
      "cause" :

      { "ok" : 0, "errmsg" : "migrate already in progress" }

      ,
      "ok" : 0,
      "errmsg" : "moveChunk failed to engage TO-shard in the data transfer: migrate already in progress"
      },
      "ok" : 0,
      "errmsg" : "move failed"
      }
      Error: Printing Stack Trace
      at printStackTrace (src/mongo/shell/utils.js:38:15)
      at doassert (src/mongo/shell/assert.js:6:5)
      at assert (src/mongo/shell/assert.js:14:5)
      at D:\data\mci\git@github.commongodb\mongo.git\master\jstests\sharding\hash_basic.js:80:5
      at Array.forEach (native)
      at D:\data\mci\git@github.commongodb\mongo.git\master\jstests\sharding\hash_basic.js:74:11

            Assignee:
            benety.goh@mongodb.com Benety Goh
            Reporter:
            benety.goh@mongodb.com Benety Goh
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: