Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-34530

Shard server crashes after access violation on Windows v3.7.4-6-g228106a741

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Sharding
    • None
    • ALL
    • Sharding 2018-04-23

      In the following Python driver test run a shard server crashed after unhandled exception: https://evergreen.mongodb.com/task/mongo_python_driver_tests_windows_vs2015_python_version__auth_ssl~auth_ssl_windows_vs2015_python_version~2.6_test_latest_sharded_cluster_d1ee646d7203bffba4c65edf66d3db1cb33518b3_18_04_17_20_23_52

      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] MongoDB starting : pid=4772 port=27217 dbpath=c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\mongo-jufiiu 64-bit host=WIN-T1NSTPV2UDM
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] db version v3.7.4-6-g228106a741
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] git version: 228106a7416288ad6263ab67878477cc23e9c23f
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] allocator: tcmalloc
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] modules: enterprise 
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten] build environment:
      2018-04-17T20:33:43.398+0000 I CONTROL  [initandlisten]     distmod: windows-64
      2018-04-17T20:33:43.399+0000 I CONTROL  [initandlisten]     distarch: x86_64
      2018-04-17T20:33:43.399+0000 I CONTROL  [initandlisten]     target_arch: x86_64
      2018-04-17T20:33:43.399+0000 I CONTROL  [initandlisten] options: { config: "c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\mongo-y8jggw", net: { bindIp: "127.0.0.1,::1", compression: { compressors: "zlib,snappy,noop" }, ipv6: true, port: 27217, ssl: { CAFile: "C:/data/mci/71adf00840eee64d74f9bd1375d5226e/drivers-tools/.evergreen/x509gen/ca.pem", PEMKeyFile: "C:/data/mci/71adf00840eee64d74f9bd1375d5226e/drivers-tools/.evergreen/x509gen/server.pem", mode: "requireSSL", weakCertificateValidation: true } }, replication: { enableMajorityReadConcern: true, oplogSizeMB: 100, replSet: "d32c6dd4-eaa7-4548-82b7-edfa1b821bcc" }, security: { keyFile: "c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\tmphikgfm\key" }, setParameter: { enableTestCommands: "1" }, sharding: { clusterRole: "shardsvr" }, storage: { dbPath: "c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\mongo-jufiiu" }, systemLog: { destination: "file", path: "c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\mongo-jufiiu\mongod.log" } }
      2018-04-17T20:33:43.400+0000 I STORAGE  [initandlisten] Detected data files in c:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\.evergreen\orchestration\db\mongo-jufiiu created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
      2018-04-17T20:33:43.400+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3327M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
      2018-04-17T20:33:43.431+0000 I STORAGE  [initandlisten] WiredTiger message [1523997223:431856][4772:1995256704], txn-recover: Set global recovery timestamp: 0
      2018-04-17T20:33:43.460+0000 I STORAGE  [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs
      2018-04-17T20:33:43.460+0000 I STORAGE  [initandlisten] The size storer reports that the oplog contains 0 records totaling to 0 bytes
      2018-04-17T20:33:43.460+0000 I STORAGE  [initandlisten] Scanning the oplog to determine where to place markers for truncation
      2018-04-17T20:33:43.479+0000 I CONTROL  [initandlisten] 
      .
      .
      .
      2018-04-17T20:38:44.830+0000 I CONTROL  [thread582] *** unhandled exception (access violation) at 0x000007FEEF848BD6, terminating
      2018-04-17T20:38:44.830+0000 I CONTROL  [thread582] *** access violation was a read from 0x40
      2018-04-17T20:38:44.830+0000 I CONTROL  [thread582] *** stack trace for unhandled exception:
      2018-04-17T20:38:45.004+0000 I -        [thread582] MSVCP140.dll                                                                                              Mtx_destroy+0x70x
      mongod.exe    ...\src\mongo\s\catalog_cache.cpp(363)                                                      mongo::CatalogCache::invalidateShardedCollection+0x63x
      mongod.exe    ...\src\mongo\s\catalog_cache.cpp(270)                                                      mongo::CatalogCache::getShardedCollectionRoutingInfoWithRefresh+0x77x
      mongod.exe    ...\src\mongo\db\sessions_collection_sharded.cpp(60)                                        mongo::SessionsCollectionSharded::_checkCacheForSessionsCollection+0x166x
      mongod.exe    ...\src\mongo\db\sessions_collection_sharded.cpp(75)                                        mongo::SessionsCollectionSharded::setupSessionsCollection+0x22x
      mongod.exe    ...\src\mongo\db\logical_session_cache_impl.cpp(264)                                        mongo::LogicalSessionCacheImpl::_refresh+0x341x
      mongod.exe    ...\src\mongo\db\logical_session_cache_impl.cpp(162)                                        mongo::LogicalSessionCacheImpl::_periodicRefresh+0x39x
      mongod.exe    ...\src\mongo\util\periodic_runner_asio.cpp(96)                                             <lambda_aca5a7c3ea2730571ac362eb390ff069>::operator()+0x442x
      mongod.exe    c:\program files (x86)\microsoft visual studio 14.0\vc\include\functional(214)              std::_Func_impl<<lambda_aca5a7c3ea2730571ac362eb390ff069>,std::allocator<int>,void,std::error_code>::_Do_call+0x26x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\handler_invoke_hook.hpp(69)               asio::asio_handler_invoke<asio::detail::binder1<std::function<void __cdecl(std::error_code)>,std::error_code> >+0x55x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\impl\strand_service.hpp(61)        asio::detail::strand_service::dispatch<asio::detail::binder1<std::function<void __cdecl(std::error_code)>,std::error_code> >+0x98x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\wrapped_handler.hpp(86)            asio::detail::wrapped_handler<asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running>::operator()<std::error_code>+0x72x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\completion_handler.hpp(69)         asio::detail::completion_handler<asio::detail::rewrapped_handler<asio::detail::binder1<asio::detail::wrapped_handler<asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running>,std::error_code>,std::function<void __cdecl(std::error_code)> > >::do_complete+0x248x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\impl\strand_service.hpp(87)        asio::detail::strand_service::dispatch<asio::detail::rewrapped_handler<asio::detail::binder1<asio::detail::wrapped_handler<asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running>,std::error_code>,std::function<void __cdecl(std::error_code)> > >+0x294x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\wrapped_handler.hpp(231)           asio::detail::asio_handler_invoke<asio::detail::binder1<asio::detail::wrapped_handler<asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running>,std::error_code>,asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running>+0x147x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\wait_handler.hpp(71)               asio::detail::wait_handler<asio::detail::wrapped_handler<asio::io_context::strand,std::function<void __cdecl(std::error_code)>,asio::detail::is_continuation_if_running> >::do_complete+0x203x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\impl\win_iocp_io_context.ipp(420)  asio::detail::win_iocp_io_context::do_one+0x711x
      mongod.exe    ...\src\third_party\asio-master\asio\include\asio\detail\impl\win_iocp_io_context.ipp(162)  asio::detail::win_iocp_io_context::run+0x205x
      mongod.exe    ...\src\mongo\util\periodic_runner_asio.cpp(114)                                            <lambda_dbfc2572039c3735bfc79c6454ca3cfd>::operator()+0x227x
      mongod.exe    c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(247)             std::_LaunchPad<std::unique_ptr<std::tuple<<lambda_dbfc2572039c3735bfc79c6454ca3cfd> >,std::default_delete<std::tuple<<lambda_dbfc2572039c3735bfc79c6454ca3cfd> > > > >::_Run+0x119x
      mongod.exe    c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(210)             std::_Pad::_Call_func+0x9x
      ucrtbase.DLL                                                                                              crt_at_quick_exit+0x125x
      kernel32.dll                                                                                              BaseThreadInitThunk+0x13x
      2018-04-17T20:38:45.004+0000 I CONTROL  [thread582] writing minidump diagnostic file C:\data\mci\71adf00840eee64d74f9bd1375d5226e\drivers-tools\mongodb\bin\mongod.2018-04-17T20-38-45.mdmp
      2018-04-17T20:38:45.985+0000 I NETWORK  [listener] connection accepted from 127.0.0.1:50665 #582 (9 connections now open)
      2018-04-17T20:38:45.985+0000 I CONTROL  [thread582] *** immediate exit due to unhandled exception
      

        1. mongod-1026.log
          207 kB
          Shane Harvey
        2. mongod-27217.log
          365 kB
          Shane Harvey
        3. mongod-27218.log
          17 kB
          Shane Harvey
        4. mongo-orchestration.log
          1.25 MB
          Shane Harvey
        5. mongos-27017.log
          18 kB
          Shane Harvey

            Assignee:
            esha.maharishi@mongodb.com Esha Maharishi (Inactive)
            Reporter:
            shane.harvey@mongodb.com Shane Harvey
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: