Non-english language

[Tanshu334]

For some reasons, the website serves a non english language (like russia or spanish) to the browser which breaks my code

[yungd1plomat]

just use selectors based on reliable attributes like class names, ids and etc

[Tanshu334]

just use selectors based on reliable attributes like class names, ids and etc

no, i can't really do that. i'm making an AI recaptcha solver, the text on the recaptcha is in some random language which breaks my code. before applying the stealth it's in english so it is because of the stealth. can i atleast know the factor which lets the website determine the language?

[gianpaj]

It looks like it depends on _generate_accept_language() and since domain_code="com" is hard coded in _properties.py

spoofed_headers = FakeHttpHeader(domain_code="com", browser=browser_type.value)

it will randomly pick a country from COUNTRY_TOP_LEVEL_DOMAINS in constants.py in fake-http-header

https://github.com/MichaelTatarski/fake-http-header/blob/c684b6e1fca568b6a9794aea4cd5e8eb91c7c940/fake_http_header/util.py#L40-L41

tf-playwright-stealth/playwright_stealth/properties/_properties.py

Line 28 in 71fe7cf

spoofed_headers = FakeHttpHeader(domain_code="com", browser=browser_type.value)

If you set it to us you have a higher chance to get an English locale, but it's still random between

'us': ['en-US', 'es-US', 'haw', 'fr']

I think this is something that should be able to overwrite as this doesn't work:

page = browser.new_page()
config = StealthConfig(languages=("en-US", "en"))
stealth_sync(page, config=config)
page.goto("https://bing.com")

[VeArnold]

I struggled with changing the language too, and when I dived into the code, it seemed like none of the options (except the true/false options to run specific scripts) did anything - seems like someone had started to do something with it, but left it halfway through.

Due to the FakeHttpHeader implementation and intertwinement in code, it's a bit difficult to "override" some values in a clean manner. The easiest approach is to just write over all the automatically generated values, but I honestly don't think it's the cleanest, but it's what I did here:
VeArnold@69d5b71

Seems like it might require quite a big chunk of refactoring to have a clean implementation. The main thing to consider is keeping the headers and js in sync (e.g. if you straight-up just write over the language values with the current implementation, then you'll have headers that are out of sync with your js).

I think it would make sense to allow providing your headers instead of the FakeHttpHeader and have the code still handle the rest of it - just becomes a bit messy as well if you want to add more "overrides" etc - which is why I think a major refactoring makes most sense with customisability in mind.

[Tanshu334]

this library itself seems abandoned and not maintained properly to begin with. i've switched to using patchright anyway.

[VeArnold]

Yeah, seems that way. :) This fork seems to be a bit more customizable: https://github.com/Mattwmaster58/playwright_stealth

In any case, hope someone gives more love to either one of them.