Compress profiler extracts with zstd for easier sharing

[dgomez04]

Summary

This pull request integrates inline Zstandard (zstd) compression into the extract finalization step. Upon a succesful profiler run, we now generate a compressed sibling .db.zst.

• Compression occurs during the extract finalize phase, rather than as a separate downstream pipeline step.
• Generates a compressed .db.zst while retaining uncompressed .db for local debugging and UI compatibility.
• Both paths are logged upon success. If compression fails, it logs a warning but allows the overall run to succeed (non-fatal).
• Added zstandard to the direct dependencies.

Decision

Option	Pros	Cons
Retain .db + write .db.zst (Selected)	Easy local inspection; zero disruption to lakebridge-ui or other consumers expecting a live DuckDB path.	Double the local disk footprint.
Keep .db.zst only	Max disk space savings.	Requires manual decompression before downstream tools can query the database.

[github-actions]

✅ 174/174 passed, 9 flaky, 2 skipped, 1h14m8s total

Flaky tests:

• 🤪 test_installs_and_runs_local_bladebridge (12.554s)
• 🤪 test_installs_and_runs_pypi_bladebridge (22.656s)
• 🤪 test_recon_for_report_type_is_data (47.769s)
• 🤪 test_transpiles_informatica_to_sparksql_non_interactive[True] (24.182s)
• 🤪 test_transpiles_informatica_to_sparksql_non_interactive[False] (4.018s)
• 🤪 test_transpile_teradata_sql (26.377s)
• 🤪 test_transpile_teradata_sql_non_interactive[False] (24.988s)
• 🤪 test_transpile_teradata_sql_non_interactive[True] (6.193s)
• 🤪 test_transpiles_informatica_to_sparksql (23.923s)

_{Running from acceptance #5058}

[codecov]

Codecov Report

❌ Patch coverage is 76.00000% with 6 lines in your changes missing coverage. Please review.
✅ Project coverage is 69.53%. Comparing base (7f61051) to head (71ce89a).

Files with missing lines	Patch %	Lines
...databricks/labs/lakebridge/assessments/profiler.py	66.66%	4 Missing ⚠️
...databricks/labs/lakebridge/assessments/compress.py	84.61%	1 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2568      +/-   ##
==========================================
+ Coverage   69.50%   69.53%   +0.02%     
==========================================
  Files         107      108       +1     
  Lines        9626     9650      +24     
  Branches     1065     1067       +2     
==========================================
+ Hits         6691     6710      +19     
- Misses       2734     2738       +4     
- Partials      201      202       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.