fix: dedupe in int__mitxpro__coursesinprogram

[rachellougee]

What are the relevant tickets?

https://pipelines.odl.mit.edu/runs/b9b212cb-af5f-410d-b142-baf8bd098668

�[31mFailure in test dbt_expectations_expect_compound_columns_to_be_unique_int__mitxpro__coursesinprogram_course_id__program_id (models/intermediate/mitxpro/_int_mitxpro__models.yml)�[0m

  Got 21 results, configured to fail if >10

Description (What does it do?)

Deduplicate MIT xPro CMS courses-in-program staging data and remove duplicate (course_id, program_id) rows from int__mitxpro__coursesinprogram.

How can this be tested?

dbt build --select +int__mitxpro__coursesinprogram

Additional Context

[Copilot]

Pull request overview

This PR addresses duplicate records in the MIT xPro “courses in program” modeling path to resolve a failing dbt compound-uniqueness expectation on (course_id, program_id) in int__mitxpro__coursesinprogram.

Changes:

• Added raw-table deduplication to the MIT xPro CMS coursesinprogrampage staging model using the shared deduplicate_raw_table macro.
• Added a distinct selection in int__mitxpro__coursesinprogram to reduce duplicate output rows.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File	Description
src/ol_dbt/models/staging/mitxpro/stg__mitxpro__app__postgres__cms_coursesinprogrampage.sql	Deduplicates raw Airbyte-ingested CMS coursesinprogrampage records by page_ptr_id before downstream modeling.
src/ol_dbt/models/intermediate/mitxpro/int__mitxpro__coursesinprogram.sql	Attempts to remove duplicates emitted by the intermediate model by adding distinct to the final projection.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.