Skip to content

Commit 1472e33

Browse files
committed
fix: increase S3 connection pool to 50 for parallel bulk deletes
The default max_pool_connections=10 serialized 50 concurrent delete requests into 5 rounds, adding ~4s latency per round against Ceph.
1 parent 76f6b27 commit 1472e33

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

diracx-core/src/diracx/core/settings.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -275,7 +275,7 @@ async def lifetime_function(self) -> AsyncIterator[None]:
275275
async with get_session().create_client(
276276
"s3",
277277
**self.s3_client_kwargs,
278-
config=Config(signature_version="v4"),
278+
config=Config(signature_version="v4", max_pool_connections=50),
279279
) as self._client: # type: ignore
280280
if not await s3_bucket_exists(self._client, self.bucket_name):
281281
if not self.auto_create_bucket:

0 commit comments

Comments
 (0)