feat(ingest/snowflake): snowflake enhancements to support tasks,snowpipe and stages

[alokr-dhub]

Summary

• Add support for ingesting Snowflake Tasks as DataJob/DataFlow entities with DAG dependency tracking
  (predecessor tasks)
• Add support for ingesting Snowflake Snowpipe objects as DataJob/DataFlow entities with COPY INTO lineage
  (stage → pipe → target table)
• Add support for ingesting Snowflake Stages as containers with placeholder datasets for internal stages
  and cloud URN resolution for external stages (S3, GCS, Azure)
• All three features are opt-in via stages.enabled, tasks.enabled, and pipes.enabled config flags (default:
  False)

Test plan

• 32 unit tests covering tasks extractor, pipes extractor (including parse_copy_into regex), and stages
  extractor
• 3 integration tests with golden file validation: full stages+tasks+pipes, pipes-without-stages lineage
  resolution, and tasks-only independence
• lintFix passes clean (ruff + mypy)
• Existing snowflake integration tests unaffected (new code paths are opt-in only)
• The PR conforms to DataHub's Contributing Guideline (particularly PR Title Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[codecov]

Codecov Report

❌ Patch coverage is 80.43478% with 81 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
...hub/ingestion/source/snowflake/snowflake_schema.py	61.90%	32 Missing ⚠️
...datahub/ingestion/source/snowflake/snowflake_v2.py	19.23%	21 Missing ⚠️
...hub/ingestion/source/snowflake/snowflake_stages.py	86.51%	12 Missing ⚠️
...ahub/ingestion/source/snowflake/snowflake_pipes.py	90.90%	11 Missing ⚠️
...ahub/ingestion/source/snowflake/snowflake_query.py	66.66%	3 Missing ⚠️
...ahub/ingestion/source/snowflake/snowflake_tasks.py	97.01%	2 Missing ⚠️

📢 Thoughts on this report? Let us know!

[datahub-connector-tests]

Connector Tests Results

All connector tests passed for commit 0565cc4

View full test logs →

To skip connector tests, add the skip-connector-tests label (org members only).

Autogenerated by the connector-tests CI pipeline.

[codecov]

Bundle Report

Changes will increase total bundle size by 27 bytes (0.0%) ⬆️. This is within the configured threshold ✅

Detailed changes

Bundle name	Size	Change
datahub-react-web-esm	22.71MB	27 bytes (0.0%) ⬆️

Affected Assets, Files, and Routes:

view changes for bundle: datahub-react-web-esm

Assets Changed:

Asset Name	Size Change	Total Size	Change (%)
assets/index-*.js	27 bytes	12.46MB	0.0%

[alwaysmeticulous]

🔴 Meticulous spotted visual differences in 928 of 1805 screens tested: view and approve differences detected.

Meticulous evaluated ~8 hours of user flows against your PR.

_{Last updated for commit 19c3288 fix: linting fixes. This comment will update as new commits are pushed.}

[github-actions]

Linear: ING-2198

[treff7es]

@alokr-dhub something is wrong with this pr, why the change is sooo huge?

[treff7es]

This pr seemingly has unrelated changes. It needs to be removed.

[alokr-dhub]

@treff7es Addressed all comments. Please review.

[treff7es]

lgtm