Dumping fails on some competition

[Didayolo]

Example of such competition:
https://codalab.lisn.upsaclay.fr/competitions/3627/dumps/

[hazirbas]

Hi, I am having the same issue and would like to transfer my competition to Codabench as soon as possible. How can I get some support here?
https://competitions.codalab.org/competitions/17807/dumps/

[Didayolo]

Hi @hazirbas,

I am currently unavailable to help with this matter, but @ObadaS may be, or may be able to redirect the issue to the right person.

Best regards.

[hazirbas]

Hi @ObadaS , can you help us with this as we are rushing to move the competition for the CVPR deadline?

[Didayolo]

@hazirbas Have you made any progress on this? If no, can you please share your CodaLab username so I can investigate the issue?

[hazirbas]

@Didayolo no progress, my username is hazirbas.

[Didayolo]

Some logs:

worker_site  | [2025-11-26 01:42:40,399: INFO/MainProcess] Received task: apps.web.tasks.make_modified_bundle[6f4d6330-e5ea-4a1e-a88d-8979572a4c22]
worker_site  | 2025-11-26 01:42:40,409 INFO Creating Competion dump
worker_site  | [2025-11-26 01:42:40,409: INFO/Worker-6] Creating Competion dump
worker_site  | 2025-11-26 01:42:40,421 INFO Adding end-date
worker_site  | [2025-11-26 01:42:40,421: INFO/Worker-6] Adding end-date
worker_site  | 2025-11-26 01:42:40,444 INFO Adding HTML
worker_site  | [2025-11-26 01:42:40,444: INFO/Worker-6] Adding HTML
worker_site  | [2025-11-26 01:42:40,448: INFO/Worker-6] Adding HTML
worker_site  | 2025-11-26 01:42:40,448 INFO Adding HTML
worker_site  | [2025-11-26 01:42:40,452: INFO/Worker-6] Adding HTML
worker_site  | 2025-11-26 01:42:40,452 INFO Adding HTML
worker_site  | 2025-11-26 01:42:40,456 INFO Adding HTML
worker_site  | [2025-11-26 01:42:40,456: INFO/Worker-6] Adding HTML
worker_site  | 2025-11-26 01:42:40,460 INFO Adding HTML
worker_site  | [2025-11-26 01:42:40,460: INFO/Worker-6] Adding HTML
worker_site  | 2025-11-26 01:42:40,493 INFO Adding phase
worker_site  | [2025-11-26 01:42:40,493: INFO/Worker-6] Adding phase
worker_site  | 2025-11-26 01:42:40,493 INFO Current data type is reference_data
worker_site  | [2025-11-26 01:42:40,493: INFO/Worker-6] Current data type is reference_data
[...]
worker_site  | 2025-11-26 01:44:01,491 INFO There was an error making a Competition dump
worker_site  | [2025-11-26 01:44:01,491: INFO/Worker-6] There was an error making a Competition dump
worker_site  | 2025-11-26 01:44:01,493 INFO Traceback (most recent call last):
worker_site  |   File "/app/codalab/apps/web/tasks.py", line 1018, in make_modified_bundle
worker_site  |     if data_field.file.name not in file_cache.keys():
worker_site  |   File "/usr/local/lib/python2.7/site-packages/django/db/models/fields/files.py", line 46, in _get_file
worker_site  |     self._file = self.storage.open(self.name, 'rb')
worker_site  |   File "/usr/local/lib/python2.7/site-packages/django/core/files/storage.py", line 33, in open
worker_site  |     return self._open(name, mode)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/storages/backends/s3boto.py", line 384, in _open
worker_site  |     f = self.file_class(name, mode, self)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/storages/backends/s3boto.py", line 92, in __init__
worker_site  | [2025-11-26 01:44:01,493: INFO/Worker-6] Traceback (most recent call last):
worker_site  |   File "/app/codalab/apps/web/tasks.py", line 1018, in make_modified_bundle
worker_site  |     if data_field.file.name not in file_cache.keys():
worker_site  |   File "/usr/local/lib/python2.7/site-packages/django/db/models/fields/files.py", line 46, in _get_file
worker_site  |     self._file = self.storage.open(self.name, 'rb')
worker_site  |   File "/usr/local/lib/python2.7/site-packages/django/core/files/storage.py", line 33, in open
worker_site  |     return self._open(name, mode)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/storages/backends/s3boto.py", line 384, in _open
worker_site  |     f = self.file_class(name, mode, self)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/storages/backends/s3boto.py", line 92, in __init__
worker_site  |     self.key = storage.bucket.get_key(self._storage._encode_name(name))
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/bucket.py", line 193, in get_key
worker_site  |     key, resp = self._get_key_internal(key_name, headers, query_args_l)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/bucket.py", line 200, in _get_key_internal
worker_site  |     query_args=query_args)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 668, in make_request
worker_site  |     retry_handler=retry_handler
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
worker_site  |     retry_handler=retry_handler)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
worker_site  |     raise ex
worker_site  | SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:726)
worker_site  | 
worker_site  |     self.key = storage.bucket.get_key(self._storage._encode_name(name))
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/bucket.py", line 193, in get_key
worker_site  |     key, resp = self._get_key_internal(key_name, headers, query_args_l)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/bucket.py", line 200, in _get_key_internal
worker_site  |     query_args=query_args)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 668, in make_request
worker_site  |     retry_handler=retry_handler
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
worker_site  |     retry_handler=retry_handler)
worker_site  |   File "/usr/local/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
worker_site  |     raise ex
worker_site  | SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:726)
worker_site  | 
worker_site  | [2025-11-26 01:44:01,577: INFO/MainProcess] Task apps.web.tasks.make_modified_bundle[6f4d6330-e5ea-4a1e-a88d-8979572a4c22] succeeded in 81.1758210957s: None

[Didayolo]

@hazirbas

I think a work-around is the following:

• Get the original bundle uploaded to CodaLab (if you don't have it, we may be able to retrieve it in the storage)
• Download most recent versions of reference_data and scoring_program (in "My Datasets" interface : https://competitions.codalab.org/my/datasets/)
• Update the original bundle with these elements, and potentially also settings and documentation pages from the "EDIT" menu

As the competition is quite old, it may need some adaptation anyway to work fine on Codabench.

[hazirbas]

@Didayolo gotcha, well I will look into it, but may also prefer to end the competition at this point. Also yes I would need the original bundle from the storage.

[Didayolo]

@ObadaS Any tip for getting the original bundle from the storage?

[ObadaS]

Unfortunately it's not that simple since the data is saved with different keys in MinIO. We would need to fix the SSL error by either updating some packages like requests or import the code from the autoDLMinio branch so that the website uses the mc command instead of python package.

[Didayolo]

OK so maybe this one needs to be manually ported to Codabench...

[hazirbas]

Hi @Didayolo and @ObadaS, can you help me with this?