This is related to aio-libs/aiobotocore#864
A batch job monitor can crash hard due to an expired signature in the client, e.g.
File "/opt/conda/envs/gis/lib/python3.7/site-packages/aio_aws/aio_aws_batch.py", line 1102, in aio_batch_job_manager
await aio_batch_job_waiter(job, config=config)
File "/opt/conda/envs/gis/lib/python3.7/site-packages/aio_aws/aio_aws_batch.py", line 1001, in aio_batch_job_waiter
response = await aio_batch_job_status([job.job_id], config)
File "/opt/conda/envs/gis/lib/python3.7/site-packages/aio_aws/aio_aws_batch.py", line 824, in aio_batch_job_status
return await batch_client.describe_jobs(jobs=jobs)
File "/opt/conda/envs/gis/lib/python3.7/site-packages/aiobotocore/client.py", line 155, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidSignatureException) when calling the DescribeJobs operation: Signature expired: 20210908T202653Z is now earlier than 20210908T202940Z (20210908T203440Z - 5 min.)
It might be possible to work around this by adding options to increase a connection or read timeout, e.g.
client_config = AioConfig(
connect_timeout=20,
read_timeout=900,
max_pool_connections=max_pool_connections,
)
async with aio_batch_config.create_client("batch", config=client_config) as batch_client:
# run batch monitoring for any long-running batch jobs
passAnother similar pattern uses a default config:
client_config = aio_config.session.get_default_client_config()
s3_config = AioConfig(signature_version=UNSIGNED)
s3_config = client_config.merge(s3_config)
async with aio_config.create_client("s3", config=s3_config) as s3_client:
# do s3 stuff
passThe monitoring code might need to detect and catch exceptions for invalid signatures. It could replace the client with a new one, or find some way to update the signature for a client.
This is related to aio-libs/aiobotocore#864
A batch job monitor can crash hard due to an expired signature in the client, e.g.
It might be possible to work around this by adding options to increase a connection or read timeout, e.g.
Another similar pattern uses a default config:
The monitoring code might need to detect and catch exceptions for invalid signatures. It could replace the client with a new one, or find some way to update the signature for a client.