Skip to content

chore: snowpark splits objects into multiple files#3

Merged
vipoliveira merged 1 commit into
mainfrom
DC-307
Dec 2, 2025
Merged

chore: snowpark splits objects into multiple files#3
vipoliveira merged 1 commit into
mainfrom
DC-307

Conversation

@vipoliveira
Copy link
Copy Markdown
Collaborator

@vipoliveira vipoliveira commented Nov 27, 2025

Tests:

https://dbc-8fd29457-254a.cloud.databricks.com/jobs/805734467618831/runs/183406827227487?o=3124857632990847

============================================================
SNOWPARK OBJECT READER
============================================================
Connecting to Snowflake account: [REDACTED]
User: [REDACTED]
Database: DATA_MIGRATION_DB, Schema: DATA_MIGRATION_SCHEMA
Warehouse: COMPUTE_WH
✓ Successfully connected to Snowflake using Snowpark
✓ Snowflake version: 9.37.1

📊 Reading all Snowflake objects using Snowpark...
✓ Found 2 tables
✓ Found 1 views
✓ Found 2 procedures
✓ Found 1 functions
✓ Found 1 sequences
✓ Found 1 stages
✓ Found 2 file_formats
✓ Found 1 tasks
✓ Found 1 streams
✓ Found 1 pipes

============================================================
SNOWFLAKE OBJECTS SUMMARY
============================================================
{
  "database": "DATA_MIGRATION_DB",
  "schema": "DATA_MIGRATION_SCHEMA",
  "counts": {
    "tables": 2,
    "views": 1,
    "procedures": 2,
    "functions": 1,
    "sequences": 1,
    "stages": 1,
    "file_formats": 2,
    "tasks": 1,
    "streams": 1,
    "pipes": 1
  }
}

🔍 Querying specific test objects...
  (Note: Objects must be created first by running snowflake_test_objects.sql)
  - Querying data_migration_source table...
    ✓ Found 0 rows
  - Querying data_migration_target table...
    ✓ Found 0 rows
  - ⚠ data_migration_active_sources view does not exist (run snowflake_test_objects.sql to create it)
  - ⚠ data_migration_summary view does not exist (run snowflake_test_objects.sql to create it)
  - ⚠ data_migration_status_ranked view does not exist (run snowflake_test_objects.sql to create it)
  - Querying data_migration_monthly_summary view...
    ✓ Found 0 rows

📊 Reading all Snowflake objects using Snowpark...
✓ Found 2 tables
✓ Found 1 views
✓ Found 2 procedures
✓ Found 1 functions
✓ Found 1 sequences
✓ Found 1 stages
✓ Found 2 file_formats
✓ Found 1 tasks
✓ Found 1 streams
✓ Found 1 pipes
Wrote 8860 bytes.
  ✓ Saved tables to tables.json
Wrote 777 bytes.
  ✓ Saved views to views.json
Wrote 1767 bytes.
  ✓ Saved procedures to procedures.json
Wrote 1024 bytes.
  ✓ Saved functions to functions.json
Wrote 484 bytes.
  ✓ Saved sequences to sequences.json
Wrote 689 bytes.
  ✓ Saved stages to stages.json
Wrote 1902 bytes.
  ✓ Saved file_formats to file_formats.json
Wrote 1322 bytes.
  ✓ Saved tasks to tasks.json
Wrote 791 bytes.
  ✓ Saved streams to streams.json
Wrote 722 bytes.
  ✓ Saved pipes to pipelines.json

✓ Saved 10 artifact files to Unity Catalog Volume: /Volumes/qubika_partner_solutions/migration_accelerator/snowflake_artifacts_raw

✓ All operations completed successfully!

✓ Session closed

Copy link
Copy Markdown
Collaborator

@FacuSentena FacuSentena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, good use of class inheritance 👏 .

@vipoliveira vipoliveira merged commit 3e9020a into main Dec 2, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants