-
Type: Task
-
Resolution: Unresolved
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
None
-
Python Drivers
After the changes in PYTHON-4350, the GridFsMultiFileDownload benchmark has high variance. For example the most recent build dropped by 15%: https://spruce.mongodb.com/task/mongo_python_driver_perf_tests_perf_6.0_standalone_e40ff3516821ce79252bef60fce41bf3d93ae110_24_04_11_01_19_51/trend-charts?execution=0&sortBy=STATUS&sortDir=ASC
This could also be related to HELP-58235.
For now we should increase the benchmark runtime from 60 seconds back to 3-5 minutes.
Also see this:
https://performance-analyzer.server-tig.prod.corp.mongodb.com/perf-analyzer-viz/?comparison_id=bd0d07ee-4c84-4573-8877-e33e100b92d9&selected_tab=data-table&percent_filter=0%7C%7C100&z_filter=0%7C%7C10
- is caused by
-
PYTHON-4350 Faster and more consistent performance benchmark execution times
- Closed