Skip to content

chore: deprecate rubygems-dependents-ingest workflow - #4339

Merged
mbani01 merged 1 commit into
mainfrom
chore/disable_rubygems_dependents_workflow
Jul 14, 2026
Merged

chore: deprecate rubygems-dependents-ingest workflow#4339
mbani01 merged 1 commit into
mainfrom
chore/disable_rubygems_dependents_workflow

Conversation

@mbani01

@mbani01 mbani01 commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

This pull request removes all code related to fetching and processing RubyGems dependents data from the packages_worker service. The dependent count ingestion workflow, its scheduling, configuration, and all related activities and database functions have been deleted. The service will no longer attempt to fetch or store RubyGems reverse dependency information.

The most important changes are:

Removal of RubyGems dependents ingestion workflow and scheduling:

  • Deleted the ingestRubyGemsDependents workflow and its registration from the workflows index (workflows/index.ts, rubygems/workflows.ts). [1] [2]
  • Removed the scheduled task for RubyGems dependents ingestion from the scheduler (rubygems/schedule.ts). [1] [2]

Removal of RubyGems dependents processing logic:

  • Deleted the processRubyGemsDependentsBatch activity and all related code from the activities export, implementation, and configuration (activities.ts, rubygems/activities.ts, config.ts). [1] [2] [3] [4]
  • Removed the entire runRubyGemsDependentsLoop.ts file, which contained the logic for fetching reverse dependencies and updating the database.

Cleanup of RubyGems dependents client and data access:

  • Removed the fetchReverseDependencies client function from the RubyGems API client (rubygems/client.ts).
  • Deleted the data access functions and types for listing and updating RubyGems packages for dependents in the data access layer (data-access-layer/src/osspckgs/rubygems.ts).

Signed-off-by: Mouad BANI <mouad-mb@outlook.com>
@mbani01 mbani01 self-assigned this Jul 14, 2026
Copilot AI review requested due to automatic review settings July 14, 2026 12:08
@cursor

cursor Bot commented Jul 14, 2026

Copy link
Copy Markdown

PR Summary

Low Risk
Deletion-only change in a non-core ingestion lane; existing RubyGems core/critical flows remain. Stale dependent_count values may persist until another source updates them.

Overview
Removes the RubyGems reverse-dependencies / dependent-count ingestion path from packages_worker. The worker will no longer call RubyGems for reverse_dependencies, run the weekly dependents workflow, or update packages.dependent_count via that loop.

Worker & Temporal: Drops ingestRubyGemsDependents, processRubyGemsDependentsBatch, and scheduleRubyGemsDependentsIngestion (including startup in rubygems-worker.ts). Core and critical RubyGems schedules/workflows are unchanged.

Implementation cleanup: Deletes runRubyGemsDependentsLoop.ts, fetchReverseDependencies in the RubyGems client, getRubyGemsDependentsConfig, and DAL helpers listRubyGemsPackagesForDependents / updateRubyGemsDependentCount.

Reviewed by Cursor Bugbot for commit 2d800af. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Removes the legacy RubyGems reverse-dependency ingestion path while retaining core and critical RubyGems ingestion.

Changes:

  • Removes the Temporal workflow, activity, and schedule registration.
  • Deletes reverse-dependency fetching and database update logic.
  • Removes related configuration and exports.

Reviewed changes

Copilot reviewed 9 out of 10 changed files in this pull request and generated no comments.

Show a summary per file
File Description
services/libs/data-access-layer/src/osspckgs/rubygems.ts Removes dependent-count DAL functions.
services/apps/packages_worker/src/workflows/index.ts Removes workflow export.
services/apps/packages_worker/src/rubygems/workflows.ts Removes dependents workflow.
services/apps/packages_worker/src/rubygems/schedule.ts Removes schedule definition.
services/apps/packages_worker/src/rubygems/runRubyGemsDependentsLoop.ts Deletes processing loop.
services/apps/packages_worker/src/rubygems/client.ts Removes reverse-dependencies API call.
services/apps/packages_worker/src/rubygems/activities.ts Removes dependents activity.
services/apps/packages_worker/src/config.ts Removes dependents configuration.
services/apps/packages_worker/src/bin/rubygems-worker.ts Stops registering the schedule.
services/apps/packages_worker/src/activities.ts Removes activity export.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@mbani01
mbani01 merged commit d320aa8 into main Jul 14, 2026
16 checks passed
@mbani01
mbani01 deleted the chore/disable_rubygems_dependents_workflow branch July 14, 2026 12:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants