-
Type: Task
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: 5.0.0-rc0
-
Component/s: None
-
Fully Compatible
-
v5.0
-
Sharding EMEA 2021-05-31, Sharding EMEA 2021-06-14
Since cluster writes can't be unit tested, some DDL utilities had been written using catalog client calls that can be very inefficient. Considering that also batched requests are unit-testable (when using the ConfigServerFixture - as in ddl util tests), some performance improvements can be applied.
Performance problems:
- The updateTags function uses the catalog client to update tags in an extremely inefficient way.
- The deletion of chunks / tags can hit the catalog client timeout in case of a lot of documents to delete.
Action points:
- Replace updateTags logic with a simple batch update.
- Replace the above mentioned delete calls with batched deletes.