crawl-openathena

This repo contains the project plan and issues related to steering Common Crawl's crawl using quality signals. The crawl is currently mostly steered using search-engine-style ranking.

This project is currently in a pilot phase.