Right now we are running our full benchmark suite every time you push a commit to a PR. ASV has a quick mode "-q" that greatly speeds up the benchmarks (at the cost of some accuracy), which should be run for PRs, and then we should only run the full suite after merging a PR.