Hello! :]
This is a project made to help me showcase the reach of my abilities to adapt to new learnings. Particularly, this project is going to be a data project. In it, I will do ETL labor, present some analytics in a dashboard, and finally will try to some AI based on that data.
The project right now fetches the hungarian tenders API every hour to look for updates, and saves them in a sql database tenders.sqlite.
The project runs with the file etl.py. This file runs a scheduler that each hour fetchs the tenders API and updates the sqlite db with the new tenders. To do so, simply run python3 etl.py
You can also run a tunned down version of the project, with the flags --test and --test2 (for example, python3 etl.py --test). This will only try to fetch 500 of the tenders (the difference consisting in the page numbers being fetched), and said tenders will be stored in different databases from the production one, tenders_test.sqlite and tenders_test2.sqlite respectively.
It is good if you want to see the reach of the project :]