Skip to content

Commit 901fb45

Browse files
dinethjanithadinethjanitha
committed
Update WebCrawSpider settings: reduce CLOSESPIDER_PAGECOUNT and max_pages to 3 for stricter crawling limits.
1 parent d5fb4d2 commit 901fb45

2 files changed

Lines changed: 652 additions & 108 deletions

File tree

0 commit comments

Comments
 (0)