Doing a windows build twice in a row in evergreen (via restarting) showed that the cache is having issues. In the original tests I only say 21% cache hits for the exact same build. This indicates some non-determinism is being introduced into the inputs for some of the windows build, making it impossible to get cache hits for those. This ticket should investigate the issue and fix the windows build.

See https://bazel.build/remote/cache-remote#troubleshooting_cache_hits for some hints