Major - P3 My server run very well in 2.2.3.
I upgrade in 2.4.1 but have some memory leak (see : https://jira.mongodb.org/browse/SERVER-9534) and need restart mongodb each 24-48h
I upgrade to 2.4.3 but with this version, mongod crash after some hours.
The trace :
Thu May 2 13:46:03.265 [conn116] Assertion: 13548:BufBuilder attempted to grow() to 134217728 bytes, past the 64MB limit. 0xdcf361 0xd90a1b 0x6e6bc0 0xd70e9e 0xd7074d 0xd713ef 0xd700fc 0xd70a9e 0xd713ef 0xd7198e 0xd64831 0x869d7a 0x86bb00 0x8d236a 0x8d5535 0x8d6592 0xa7c97b 0xa80360 0x9f44d4 0x9f57e2 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdcf361] /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd90a1b] /usr/bin/mongod(_ZN5mongo11_BufBuilderINS_16TrivialAllocatorEE15grow_reallocateEv+0xf0) [0x6e6bc0] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0xb3e) [0xd70e9e] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x3ed) [0xd7074d] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope15v8ToMongoObjectERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x2bc) [0xd700fc] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x73e) [0xd70a9e] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope9getObjectEPKc+0xbe) [0xd7198e] /usr/bin/mongod(_ZN5mongo11PooledScope9getObjectEPKc+0x11) [0xd64831] /usr/bin/mongod(_ZN5mongo12GroupCommand5groupERKSsS2_RKNS_7BSONObjES3_S2_S2_PKcS3_S2_RSsRNS_14BSONObjBuilderE+0xc2a) [0x869d7a] /usr/bin/mongod(_ZN5mongo12GroupCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0xc60) [0x86bb00] /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0x8d236a] /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xbd5) [0x8d5535] /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x5e2) [0x8d6592] /usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x3b) [0xa7c97b] /usr/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xd50) [0xa80360] /usr/bin/mongod() [0x9f44d4] /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x392) [0x9f57e2] Thu May 2 13:46:03.270 [conn116] Assertion: 13548:BufBuilder attempted to grow() to 134217728 bytes, past the 64MB limit. 0xdcf361 0xd90a1b 0x6e6bc0 0x6ed2d8 0x6ed6b5 0xd7108d 0xd713ef 0xd700fc 0xd70a9e 0xd713ef 0xd7198e 0xd64831 0x869d7a 0x86bb00 0x8d236a 0x8d5535 0x8d6592 0xa7c97b 0xa80360 0x9f44d4 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdcf361] /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd90a1b] /usr/bin/mongod(_ZN5mongo11_BufBuilderINS_16TrivialAllocatorEE15grow_reallocateEv+0xf0) [0x6e6bc0] /usr/bin/mongod(_ZN5mongo14BSONObjBuilder5_doneEv+0x278) [0x6ed2d8] /usr/bin/mongod(_ZN5mongo14BSONObjBuilderD1Ev+0x95) [0x6ed6b5] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0xd2d) [0xd7108d] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope15v8ToMongoObjectERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x2bc) [0xd700fc] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x73e) [0xd70a9e] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope9getObjectEPKc+0xbe) [0xd7198e] /usr/bin/mongod(_ZN5mongo11PooledScope9getObjectEPKc+0x11) [0xd64831] /usr/bin/mongod(_ZN5mongo12GroupCommand5groupERKSsS2_RKNS_7BSONObjES3_S2_S2_PKcS3_S2_RSsRNS_14BSONObjBuilderE+0xc2a) [0x869d7a] /usr/bin/mongod(_ZN5mongo12GroupCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0xc60) [0x86bb00] /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0x8d236a] /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xbd5) [0x8d5535] /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x5e2) [0x8d6592] /usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x3b) [0xa7c97b] /usr/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xd50) [0xa80360] /usr/bin/mongod() [0x9f44d4] Thu May 2 13:46:03.274 terminate() called, printing stack (if implemented for platform): 0xdcf361 0x6ce59e 0x7f36a5b3e166 0x7f36a5b3d059 0x7f36a5b3db01 0x7f36a55eb7f3 0x7f36a55eb8b8 0x6ed6f9 0xd7108d 0xd713ef 0xd700fc 0xd70a9e 0xd713ef 0xd7198e 0xd64831 0x869d7a 0x86bb00 0x8d236a 0x8d5535 0x8d6592 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdcf361] /usr/bin/mongod(_ZN5mongo11myterminateEv+0x3e) [0x6ce59e] /usr/lib/libstdc++.so.6(+0xcb166) [0x7f36a5b3e166] /usr/lib/libstdc++.so.6(+0xca059) [0x7f36a5b3d059] /usr/lib/libstdc++.so.6(__gxx_personality_v0+0x261) [0x7f36a5b3db01] /lib/libgcc_s.so.1(+0x107f3) [0x7f36a55eb7f3] /lib/libgcc_s.so.1(_Unwind_Resume+0x68) [0x7f36a55eb8b8] /usr/bin/mongod(_ZN5mongo14BSONObjBuilderD1Ev+0xd9) [0x6ed6f9] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0xd2d) [0xd7108d] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope15v8ToMongoObjectERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x2bc) [0xd700fc] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x73e) [0xd70a9e] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope9getObjectEPKc+0xbe) [0xd7198e] /usr/bin/mongod(_ZN5mongo11PooledScope9getObjectEPKc+0x11) [0xd64831] /usr/bin/mongod(_ZN5mongo12GroupCommand5groupERKSsS2_RKNS_7BSONObjES3_S2_S2_PKcS3_S2_RSsRNS_14BSONObjBuilderE+0xc2a) [0x869d7a] /usr/bin/mongod(_ZN5mongo12GroupCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0xc60) [0x86bb00] /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0x8d236a] /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xbd5) [0x8d5535] /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x5e2) [0x8d6592] Thu May 2 13:46:03.278 Got signal: 6 (Aborted). Thu May 2 13:46:03.281 Backtrace: 0xdcf361 0x6cf729 0x7f36a52ab230 0x7f36a52ab1b5 0x7f36a52adfc0 0x6ce5a3 0x7f36a5b3e166 0x7f36a5b3d059 0x7f36a5b3db01 0x7f36a55eb7f3 0x7f36a55eb8b8 0x6ed6f9 0xd7108d 0xd713ef 0xd700fc 0xd70a9e 0xd713ef 0xd7198e 0xd64831 0x869d7a /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdcf361] /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6cf729] /lib/libc.so.6(+0x32230) [0x7f36a52ab230] /lib/libc.so.6(gsignal+0x35) [0x7f36a52ab1b5] /lib/libc.so.6(abort+0x180) [0x7f36a52adfc0] /usr/bin/mongod(_ZN5mongo11myterminateEv+0x43) [0x6ce5a3] /usr/lib/libstdc++.so.6(+0xcb166) [0x7f36a5b3e166] /usr/lib/libstdc++.so.6(+0xca059) [0x7f36a5b3d059] /usr/lib/libstdc++.so.6(__gxx_personality_v0+0x261) [0x7f36a5b3db01] /lib/libgcc_s.so.1(+0x107f3) [0x7f36a55eb7f3] /lib/libgcc_s.so.1(_Unwind_Resume+0x68) [0x7f36a55eb8b8] /usr/bin/mongod(_ZN5mongo14BSONObjBuilderD1Ev+0xd9) [0x6ed6f9] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0xd2d) [0xd7108d] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope15v8ToMongoObjectERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x2bc) [0xd700fc] /usr/bin/mongod(_ZN5mongo7V8Scope16v8ToMongoElementERNS_14BSONObjBuilderERKSsN2v86HandleINS5_5ValueEEEiPNS_7BSONObjE+0x73e) [0xd70a9e] /usr/bin/mongod(_ZN5mongo7V8Scope9v8ToMongoEN2v86HandleINS1_6ObjectEEEi+0x27f) [0xd713ef] /usr/bin/mongod(_ZN5mongo7V8Scope9getObjectEPKc+0xbe) [0xd7198e] /usr/bin/mongod(_ZN5mongo11PooledScope9getObjectEPKc+0x11) [0xd64831] /usr/bin/mongod(_ZN5mongo12GroupCommand5groupERKSsS2_RKNS_7BSONObjES3_S2_S2_PKcS3_S2_RSsRNS_14BSONObjBuilderE+0xc2a) [0x869d7a]
If I downgrade in 2.2.3 or 2.4.1 > this crash don't appear.
It's difficult to know which part of the apps is in cause, but last queries in mongo slow log were some group command.