Over the last six months we have gotten 4 last minute high priority tasks from the release team because we broke something related to releasing unknowingly. It is very hard to know when we have broken something because they use the mongo-release-tools repo to manually edit our yaml which is very prone to failures.

We should at the very least add some testing that checks out the mongo-release-tools repo and runs it on the current repo. This might not be trivial and might require some changes to the mongo-release-tools repo.