-
Type: Bug
-
Resolution: Duplicate
-
Priority: Major - P3
-
None
-
Affects Version/s: 2.6.7
-
Component/s: Index Maintenance
-
None
-
Fully Compatible
-
ALL
-
- Create a very large collection of documents
- Index them
While indexing a very large collection on Windows the indexer fails half way with "Too many open files".
Document format:
{ _id: 1234, nodes: [ 1,2,3,4,5, ... ] }
Index on nodes.
2015-01-22T22:53:29.002+0800 [conn73] Index Build: 109022400/258070991 42% 2015-01-22T22:53:39.187+0800 [conn73] Index Build: 109149600/258070991 42% 2015-01-22T22:53:42.000+0800 [conn73] Index Build: 109261800/258070991 42% 2015-01-22T22:53:52.411+0800 [conn73] Assertion: 16818:error opening file "data/_tmp/extsort.509": errno:24 Too many open files 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\util\stacktrace.cpp(169) mongo::printStackTrace+0x43 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\util\log.cpp(127) mongo::logContext+0x9c 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\util\assert_util.cpp(183) mongo::msgasserted+0xfb 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\util\assert_util.cpp(174) mongo::msgasserted+0x13 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\db\sorter\sorter.cpp(801) mongo::SortedFileWriter<mongo::BSONObj,mongo::DiskLoc>::SortedFileWriter<mongo::BSONObj,mongo::DiskLoc>+0x43e 2015-01-22T22:53:56.758+0800 [conn73] mongod.exe ...\src\mongo\db\sorter\sorter.cpp(465) mongo::sorter::NoLimitSorter<mongo::BSONObj,mongo::DiskLoc,mongo::`anonymous namespace'::ComparatorWithInterruptCheck>::spill+0x106 2015-01-22T22:53:56.775+0800 [conn73] mongod.exe ...\src\mongo\db\sorter\sorter.cpp(410) mongo::sorter::NoLimitSorter<mongo::BSONObj,mongo::DiskLoc,mongo::`anonymous namespace'::ComparatorWithInterruptCheck>::add+0x83 2015-01-22T22:53:56.775+0800 [conn73] mongod.exe ...\src\mongo\db\extsort.h(61) mongo::BSONObjExternalSorter::add+0x91 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\sort_phase_one.h(53) mongo::SortPhaseOne::addKeys+0x82 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\index\btree_based_access_method.cpp(347) mongo::BtreeBulk::insert+0x8f 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\catalog\index_create.cpp(75) mongo::addKeysToIndex+0x9a 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\catalog\index_create.cpp(128) mongo::addExistingToIndex+0x57c 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\catalog\index_create.cpp(258) mongo::buildAnIndex+0x62a 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\catalog\index_catalog.cpp(336) mongo::IndexCatalog::createIndex+0x773 2015-01-22T22:53:56.798+0800 [conn73] mongod.exe ...\src\mongo\db\commands\create_indexes.cpp(187) mongo::CmdCreateIndex::run+0x12e9 2015-01-22T22:53:56.799+0800 [conn73] mongod.exe ...\src\mongo\db\dbcommands.cpp(1385) mongo::_execCommand+0x5e 2015-01-22T22:53:56.799+0800 [conn73] mongod.exe ...\src\mongo\db\dbcommands.cpp(1592) mongo::Command::execCommand+0xf09 2015-01-22T22:53:56.799+0800 [conn73] mongod.exe ...\src\mongo\db\dbcommands.cpp(1724) mongo::_runCommands+0x4a7 2015-01-22T22:53:56.799+0800 [conn73] mongod.exe ...\src\mongo\db\query\new_find.cpp(125) mongo::runCommands+0x41 2015-01-22T22:53:56.799+0800 [conn73] mongod.exe ...\src\mongo\db\query\new_find.cpp(442) mongo::newRunQuery+0x49d 2015-01-22T22:53:56.799+0800 [conn73] osm.ways 2015-01-22T22:53:56.870+0800 [conn73] background addExistingToIndex exception error opening file "data/_tmp/extsort.509": errno:24 Too many open files 2015-01-22T22:53:57.931+0800 [conn73] index build failed. spec: { v: 1, key: { nodes: 1 }, name: "nodes_1", ns: "db.refs" } error: 16818 error opening file "data/_tmp/extsort.509": errno:24 Too many open files 2015-01-22T22:53:58.174+0800 [conn73] command db.$cmd command: createIndexes { createIndexes: "refs", indexes: [ { ns: "db.refs", name: "nodes_1", key: { nodes: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:15839 w:6430126711 reslen:187 6430194ms 2015-01-22T22:53:58.234+0800 [conn65] killcursors keyUpdates:0 numYields:0 locks(micros) r:352 3722031ms 2015-01-22T22:53:58.234+0800 [conn65] end connection 127.0.0.1:53138 (7 connections now open) 2015-01-22T22:53:58.356+0800 [conn66] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:53139]
Version infos:
/* 0 */ { "version" : "2.6.7", "gitVersion" : "a7d57ad27c382de82e9cb93bf983a80fd9ac9899", "targetMinOS" : "Windows 7/Windows Server 2008 R2", "OpenSSLVersion" : "", "sysInfo" : "windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49", "loaderFlags" : "/nologo /DEBUG /INCREMENTAL:NO /LARGEADDRESSAWARE", "compilerFlags" : "/TP /nologo /EHsc /W3 /wd4355 /wd4800 /wd4267 /wd4244 /wd4290 /we4099 /Z7 /errorReport:none /MT /O2 /Oy-", "allocator" : "system", "versionArray" : [ 2, 6, 7, 0 ], "javascriptEngine" : "V8", "bits" : 64, "debug" : false, "maxBsonObjectSize" : 16777216, "ok" : 1 }
- duplicates
-
SERVER-14572 Increase C runtime stdio file limit
- Closed
- is related to
-
SERVER-17010 Reduce file handle usage in File based Sorter
- Closed