feat: Migrate to Scrapy's native AsyncCrawlerRunner #213

Job	Run time
Tests / Integration tests (3.10, ubuntu-latest)	3m 2s
Doc checks / Doc checks / Docs check	1m 15s
Tests / Integration tests (3.14, ubuntu-latest)	3m 12s
Code checks / Type check / Type check (3.14)	13s
Code checks / Actions lint check	28s
Tests / E2E tests (3.14, ubuntu-latest)	4m 34s
Code checks / Spell check	7s
Code checks / Lint check / Lint check (3.13)	13s
Code checks / Type check / Type check (3.12)	12s
Code checks / Lint check / Lint check (3.12)	11s
Code checks / Type check / Type check (3.10)	16s
Code checks / Lint check / Lint check (3.14)	11s
Code checks / Lint check / Lint check (3.11)	10s
Tests / Unit tests / Unit tests (windows-latest, 3.14)	2m 15s
Tests / Unit tests / Unit tests (windows-latest, 3.12)	3m 36s
Tests / Unit tests / Unit tests (ubuntu-latest, 3.12)	1m 31s
Tests / Unit tests / Unit tests (windows-latest, 3.10)	1m 29s
Tests / Unit tests / Unit tests (ubuntu-latest, 3.11)	54s
Tests / Unit tests / Unit tests (ubuntu-latest, 3.14)	1m 26s
Code checks / Type check / Type check (3.13)	12s
Tests / E2E tests (3.10, ubuntu-latest)	4m 34s
Tests / Unit tests / Unit tests (windows-latest, 3.13)	1m 36s
Tests / Unit tests / Unit tests (ubuntu-latest, 3.10)	56s
PR title check	6s
Tests / Unit tests / Unit tests (windows-latest, 3.11)	1m 50s
Code checks / Lint check / Lint check (3.10)	14s
Tests / Unit tests / Unit tests (ubuntu-latest, 3.13)	1m 29s
Code checks / Type check / Type check (3.11)	11s
	36m 23s

Provide feedback