Skip to content

Commit b88a3ab

Browse files
chrisburraldbr
authored andcommitted
fix: increase S3 connection pool to 50 for parallel bulk deletes
The default max_pool_connections=10 serialized 50 concurrent delete requests into 5 rounds, adding ~4s latency per round against Ceph.
1 parent f0b0c97 commit b88a3ab

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

diracx-core/src/diracx/core/settings.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -276,7 +276,7 @@ async def lifetime_function(self) -> AsyncIterator[None]:
276276
async with get_session().create_client(
277277
"s3",
278278
**self.s3_client_kwargs,
279-
config=Config(signature_version="v4"),
279+
config=Config(signature_version="v4", max_pool_connections=50),
280280
) as self._client: # type: ignore
281281
if not await s3_bucket_exists(self._client, self.bucket_name):
282282
if not self.auto_create_bucket:

0 commit comments

Comments
 (0)