What
Production crawlers are hosted in a Microsoft Azure subscription. Only MSFT staff with have access.
Without access to the Crawlers in azure we cannot
- Stop and start crawlers
- Scale instances of app services up and down
- See metrics on CPU and memory
- Configure env vars and secrets
What has been done
We have experimented by deploying one crawler into CD prod #608
That crawler is currently off.
As it's on same App Service plan as the API and Web site it caused resource contention
What we need to do before we can redeploy
Decide if App Services are suitable for the crawler
If so we would need to provision new App Service plans in CD Azure and deploy the crawler to that.
What
Production crawlers are hosted in a Microsoft Azure subscription. Only MSFT staff with have access.
Without access to the Crawlers in azure we cannot
What has been done
We have experimented by deploying one crawler into CD prod #608
That crawler is currently off.
As it's on same App Service plan as the API and Web site it caused resource contention
What we need to do before we can redeploy
Decide if App Services are suitable for the crawler
If so we would need to provision new App Service plans in CD Azure and deploy the crawler to that.