Skip to content

1485 remove broker code in v3#1559

Open
jchate6 wants to merge 17 commits into
version-3-0-alphafrom
1485-remove-broker-code-in-v3
Open

1485 remove broker code in v3#1559
jchate6 wants to merge 17 commits into
version-3-0-alphafrom
1485-remove-broker-code-in-v3

Conversation

@jchate6
Copy link
Copy Markdown
Contributor

@jchate6 jchate6 commented May 19, 2026

This severs the broker code in tom_alerts from the rest of tom_base

24 of these files are docs changes. Mostly changing wording from alerts to dataservices

Currently we are not removing either tom_catalogs or tom_alerts. These apps will still be available if they are used by custom code. They should be considered deprecated though, and users should work on transferring any references to tom_dataservices.

There is a little bit of complicated migration magic that needs to happen here. I think it should all be transparent and seamless as long as the tom_alerts app is removed from installed apps AFTER a migration is run for existing TOMs. The other situation is that someone has migrated tom_dataproducts migration 0011, but not 0013. This seems very unlikely though.

@jchate6 jchate6 linked an issue May 19, 2026 that may be closed by this pull request
@jchate6 jchate6 changed the base branch from dev to version-3-0-alpha May 19, 2026 20:25
@jchate6 jchate6 moved this to Needs Review in TOM Toolkit May 19, 2026
@jchate6 jchate6 requested review from Fingel and phycodurus May 19, 2026 21:15
Comment thread tom_alerts/tests/tests.py
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are skipping all of the tom_alerts tests for now, so they don't pollute our test suite.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change allows for this migration to be referenced by TOMS that have already run this migration.
New TOMs should use the squashed 11-15 migration below.

This migration should be able to be removed a reasonable time after release of V3 once TOMs have fully migrated.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This squashed migration will replace migrations 11-15 for new TOMs and TOMs that have already completed all 5 migrations.

Copy link
Copy Markdown
Contributor Author

@jchate6 jchate6 May 19, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as 0011

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New migration to remove reference to tom_alerts.
Needs to be run before squashed migration applies if 0011-0014 has been run

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed this functionality since it didn't work. Could be re-routed to use refactored updatereduceddata.py management command above.

Comment thread tom_dataproducts/tests/test_sharing.py Outdated
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should re-establish these tests when we fix sharing, but these only use Hermes at the moment.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See #1461

source_location = models.CharField(max_length=200, default='', blank=True)
timestamp = models.DateTimeField(null=False, blank=False, default=timezone.now, db_index=True)
value = models.JSONField(null=False, blank=False)
message = models.ManyToManyField(AlertStreamMessage, blank=True)
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the problem field that we removed.
This was used to track provenience of a datum that was retrieved via a hermes alert message.

@jchate6 jchate6 linked an issue May 19, 2026 that may be closed by this pull request
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Needs Review

Development

Successfully merging this pull request may close these issues.

Remove Broker code in V3 Management command needed to facilitate Dataservice queries.

1 participant