Skip to content

add DuckDB script for downloading monaco or a custom area from Overtu…#571

Merged
bdon merged 2 commits into
mainfrom
download-overture-script
Jul 13, 2026
Merged

add DuckDB script for downloading monaco or a custom area from Overtu…#571
bdon merged 2 commits into
mainfrom
download-overture-script

Conversation

@bdon

@bdon bdon commented Mar 3, 2026

Copy link
Copy Markdown
Member

…re as Parquet file [#541]

@migurski @wipfli

This seems more minimal than demanding installation of https://docs.overturemaps.org/getting-data/overturemaps-py/ or another custom tool?

@sonarqubecloud

sonarqubecloud Bot commented Mar 3, 2026

Copy link
Copy Markdown

@wipfli

wipfli commented Mar 4, 2026

Copy link
Copy Markdown
Collaborator

I think adding such a script is a good idea. I get the following error:

Downloading release 2026-02-18.0: 7.408446,43.722901,7.4405,43.752481 to data/sources/monaco.parquet
HTTP Error:
HTTP GET error on '/?encoding-type=url&list-type=2&prefix=release%2F2026-02-18.0%2F' (HTTP 400)
Wrote data/sources/monaco.parquet

@wipfli

wipfli commented Mar 4, 2026

Copy link
Copy Markdown
Collaborator
➜  overture git:(main) ✗ duckdb --version
v1.2.1 8e52ec4395

@wipfli

wipfli commented Mar 4, 2026

Copy link
Copy Markdown
Collaborator

I am not good at reading bash. I would prefer if we could hard-code the Overture release and the bounding box in the SQL. In the current state I would need to ask a chatbot or read about bash's syntax to know how to use this script.

@bdon

bdon commented Mar 4, 2026

Copy link
Copy Markdown
Member Author

What if we added help text?

./download-overture.sh --help
Usage: ./download-overture.sh [RELEASE] [BBOX] [OUTPUT]

Downloads Overture Maps data for a bounding box as a Parquet file.

Arguments:
  RELEASE  Overture release version              (default: 2026-02-18.0)
  BBOX     xmin,ymin,xmax,ymax in WGS84         (default: 7.408446,43.722901,7.4405,43.752481)
  OUTPUT   Output file path                      (default: data/sources/monaco.parquet)

Example:
  ./download-overture.sh 2026-02-18.0 -122.52,37.70,-122.35,37.83 data/sources/sf.parquet

@migurski

migurski commented Mar 5, 2026

Copy link
Copy Markdown
Collaborator

The help text really improves it. They expire Overture releases quite quickly btw, I think keeping just two around at any given point. My Python predecessor to this script already does not work.

➜ overture git:(main) ✗ duckdb --version
v1.2.1 8e52ec4395

Do you still see this error if you upgrade to a more recent DuckDB? Version 1.4.x should work, and I recall seeing exactly your error when I was previously stuck at version 1.1.x.

bdon added 2 commits July 13, 2026 13:47
* add bash help text
* query for latest Overture release from STAC catalog
@bdon
bdon force-pushed the download-overture-script branch from 6b41faa to 295dfe4 Compare July 13, 2026 18:24
@sonarqubecloud

Copy link
Copy Markdown

@bdon

bdon commented Jul 13, 2026

Copy link
Copy Markdown
Member Author
  • added help text
  • use DuckDB to query for the latest Overture release from STAC instead of hardcoding

@bdon
bdon merged commit 1857267 into main Jul 13, 2026
6 checks passed
@bdon
bdon deleted the download-overture-script branch July 13, 2026 18:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants