EvalAI's issue tracker is good place to start. If you find something that interests you, comment on the thread and we'll help get you started. Alternatively, if you come across a new bug on the site, please file a new issue and comment if you would like to be assigned. Existing issues are tagged with one or more labels, based on the part of the website it touches, its importance etc., which can help you select one.
Please refer to Technologies Used
Refer to GitHub Guide.
Refer to Markdown Guide.
Coverage decreases when the existing test cases don't test the new code you wrote. If you click coverage, you can see exactly which all parts aren't covered and you can write new tests to test the parts.
We recommend setting up EvalAI using Docker-based environment for reliability and consistency across systems. Please refer to our installation guide.
Q. While using docker, I am getting the following error on URL http://localhost:8888/:
Cannot Get \
Try removing the docker containers and then building them again.
createdb: could not connect to database template1: FATAL: Peer authentication failed for user "postgres"
Try creating a new user and then grant all the privileges to it and then create a db.
________________ ERROR collecting tests/unit/web/test_views.py _________________
import file mismatch:
imported module 'tests.unit.web.test_views' has this __file__ attribute:
/path/to/evalai/tests/unit/web/test_views.py
which is not the same as the test file we want to collect:
/code/tests/unit/web/test_views.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules
It appears that you are trying to run pytest in a docker container. To fix this, delete the __pycache__ and all *.pyc files using the following command:
find . | grep -E "(__pycache__|\.pyc|\.pyo$)" | xargs rm -rf
ERROR: for db Cannot start service db: driver failed programming external connectivity on endpoint evalai_db_1 (2163096de9aac6561b4f699bb1049acd0ce881fbaa0da28e47cfa9ca0ee1199f): Error starting userland proxy: listen tcp 0.0.0.0:5432: bind: address already in use
The following solution only works on Linux.
Execute :
sudo netstat -lpn |grep :5432
The output of the above would be in the following form:
tcp 0 0 127.0.0.1:5432 0.0.0.0:* LISTEN 25273/postgres
Execute the following command:
sudo kill 25273 ## This would vary and you can change with the output in the first step
ERROR : Version in "./docker-compose.yml" is unsupported. You might be seeing this error because you are using wrong Compose file version.
Since, the version of compose file is 3. You might be using a docker version which is not compatible. You can upgrade your docker engine and try again.
Starting the database seeder. Hang on...
Are you sure you want to wipe the existing development database and reseed it? (Y/N)
Exception while running run() in 'scripts.seed'
Try clearing the postgres database manually and try again.
ERROR: Service 'celery' failed to build: pull access denied for evalai_django, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
Please make sure to clone EvalAI in its default directory with name evalai. This happens because the parent directory changes the name of docker images. For instance, the image evalai_django gets renamed to evalai_dev_django if your directory is renamed to EvalAI_dev.