S3Store.from_url fails with https URL

[kylebarron]

        # ("https://nasa-power.s3.amazonaws.com/syn1deg/temporal/power_syn1deg_monthly_temporal_lst.zarr", {}),

ref developmentseed/titiler#1253 (comment)

cc @vincentsarago

[vincentsarago]

Here a better example

import obstore

url = "https://sentinel-cogs.s3.us-west-2.amazonaws.com/sentinel-s2-l2a-cogs/15/T/VK/2023/10/S2B_15TVK_20231008_0_L2A/TCI.tif"
store = obstore.store.from_url(url, skip_signature=True)
store.get_range("", start=0, end=10)


url = "https://nasa-power.s3.amazonaws.com/syn1deg/temporal/power_syn1deg_monthly_temporal_lst.zarr/.zattrs"
store = obstore.store.from_url(url, skip_signature=True)
store.get_range("", start=0, end=10)

See the difference between the sentinel-2 url (s3.us-west-2.amazonaws) and the nasa-power (s3.amazonaws)

[kylebarron]

I made an upstream PR (apache/arrow-rs-object-store#523) with the same change I made in #590 (this is a small piece of code that I vendor from upstream, so I want to make sure the two implementations stay the same)