Skip to content

12 pracujpl#18

Open
KajetanMieloch wants to merge 2 commits into
mainfrom
12-pracujpl
Open

12 pracujpl#18
KajetanMieloch wants to merge 2 commits into
mainfrom
12-pracujpl

Conversation

@KajetanMieloch
Copy link
Copy Markdown
Collaborator

No description provided.

KajetanMieloch and others added 2 commits May 10, 2026 12:02
- Remove hardcoded Windows-only AdBlock path (was crashing on macOS/Linux)
- Replace deprecated selenium API with Service class (selenium 4.x+)
- Add anti-bot-detection options (disable AutomationControlled, CDP webdriver flag)
- Remove pinned old package versions incompatible with Python 3.13

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
- Replace all XPath selectors with data-test attributes (stable, not layout-dependent)
- Switch from form interaction to direct URL search (?kw=...&wp=...&rd=N)
- Fix pagination: scroll to bottom + JS click to handle sticky footer
- Add fallback link selector (link-offer-title vs link-offer for sponsored posts)
- Collect salary and region fields (new fields available in current layout)
- Add daysBack config variable (1=24h, 3=3 days, 30=month)
- Add test_run.py for validating scraper without sending email
Tested: 134 offers collected across 3 pages (Python/Warszawa/30 days)

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
@KajetanMieloch KajetanMieloch linked an issue May 10, 2026 that may be closed by this pull request
@KajetanMieloch
Copy link
Copy Markdown
Collaborator Author

Jeszcze musze kilka rzeczy zmienic ale juz stawiam PR, bo w teorii dziala, ale jeszcze chce przystosowac do naszych potrzeb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Pracuj.pl

1 participant