Skip to content

Refactor SQLSource from monolith into abstract base#36

Merged
kmacrow merged 1 commit into
masterfrom
source-sql-refactor
Sep 25, 2025
Merged

Refactor SQLSource from monolith into abstract base#36
kmacrow merged 1 commit into
masterfrom
source-sql-refactor

Conversation

@kmacrow
Copy link
Copy Markdown
Collaborator

@kmacrow kmacrow commented Sep 24, 2025

  • SQLSource was intended to be a base class for future SQL-based source connectors but evolved into a monolith with a bunch of conditional logic for each db
  • This refactors SQLSource into an abstract base and implements dedicated classes for Postgres, Redshift, BigQuery and Snowflake based on it
  • Prepares the codebase for adding more SQL connections
  • Makes it easier to adjust db-specific code without potentially breaking other things
  • Add and tune up a bunch of unit tests

@kmacrow kmacrow changed the title Refactor SQLSource from monolith into a reasonable class hierarchy Refactor SQLSource from monolith into abstract base Sep 25, 2025
@kmacrow kmacrow force-pushed the source-sql-refactor branch from 8d5a4f8 to 18b0489 Compare September 25, 2025 16:19
@kmacrow kmacrow merged commit e5b318d into master Sep 25, 2025
3 checks passed
@kmacrow kmacrow deleted the source-sql-refactor branch September 25, 2025 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant