[PB-6050] feat: hard delete files that were deleted 6 months ago

[apsantiso]

Scheduled BullMQ job that hard-deletes files that have been in DELETED status for more than 6 months. Up to 10M files are going to be deleted per run in the first executions.

Changes

• Processor deletes in batches of 100, up to MAX_BATCHES (100,000) per run, with a progress log every 500 batches.
• The scheduler tries to enqueue a job every hour via BullMQ with a fixed jobId to prevent duplicate executions.

Limit  (cost=0.70..15.29 rows=100 width=16) (actual time=0.020..0.048 rows=100 loops=1)
  Buffers: shared hit=48
  ->  Index Only Scan using idx_user_status_updated_uuid on files  (cost=0.70..35043720.12 rows=240133977 width=16) (actual time=0.020..0.040 rows=100 loops=1)
        Index Cond: ((status = 'DELETED'::enum_files_status) AND (updated_at <= '2025-09-25 00:00:00'::timestamp without time zone))
        Heap Fetches: 7
        Buffers: shared hit=48
Planning:
  Buffers: shared hit=6
Planning Time: 0.198 ms
Execution Time: 0.067 ms

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
96.3% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud