Describe the problem
Run a scheduled job that checks active/published GTFS feeds once per day and stores the result in gtfsfeedavailabilitycheck.
Proposed solution
This can be implemented as a task withit the tasks executor
- Iterate over:
- feed.data_type = 'gtfs'
- feed.status = 'active'
- feed.operational_status = 'published'
- Execute HTTP HEAD for each feed and record response information.
- Consider concurrent calls to optimize running time
Alternatives you've considered
Add this check to the current batch process dataset function. Discarded as the batch process dataset function runs with a daily scheduler; if we want to execute this check more often, we will hit a wall here or make the current function more complex. However, we can add some checks in the batch process dataset, possibly outside MVP.
Additional context
No response
Describe the problem
Run a scheduled job that checks active/published GTFS feeds once per day and stores the result in gtfsfeedavailabilitycheck.
Proposed solution
This can be implemented as a task withit the tasks executor
Alternatives you've considered
Add this check to the current batch process dataset function. Discarded as the batch process dataset function runs with a daily scheduler; if we want to execute this check more often, we will hit a wall here or make the current function more complex. However, we can add some checks in the batch process dataset, possibly outside MVP.
Additional context
No response