Forget consumed task results; fix report file-list rendering (v2.6.52)

Maintenance task results were never forgotten and expire only after
24h: a full-library run left 1M+ result keys in the noeviction Redis,
slowing every broker/backend operation ~100x in the final stretch
(heartbeats minutes apart, misleading '0 active tasks' and 'ETA: 0m').
Both maintenance loops now forget each result after consuming it and on
abandonment, bounding Redis to in-flight tasks only.

Cleanup and file-changes reports store file lists (objects) in the
directories field; the report-details modal rendered them as
'[object Object]' rows. It now shows labeled, escaped file lists
(Orphaned Files / Changed Files) capped at 100 entries.

Sub-minute cleanup ETA reads '<1m' instead of '0m'.

Author: ttlequals0

CHANGELOG.MD

@@ -5,6 +5,14 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0).
 
+## [2.6.52] - 2026-06-11
+
+### Fixed
+
+- **Maintenance runs no longer flood Redis with a million result keys.** Task results were never forgotten and expire only after 24h, so a full-library cleanup or integrity run accumulated 1M+ result keys in the noeviction Redis - observed live as every broker/backend operation slowing ~100x once roughly 1M files had been processed (heartbeats minutes apart in the final stretch, "0 active tasks" snapshots, misleading "ETA: 0m"). Both maintenance loops now forget each result after consuming it (and on abandonment), bounding Redis to in-flight tasks only (~5,000 keys instead of 1.18M).
+- **Scan report details no longer render "[object Object]" rows.** Cleanup and file-changes reports store file lists (objects with file_path/change_type) in the directories field; the report modal now renders those as labeled file lists (Orphaned Files / Changed Files, capped at 100 entries) instead of joining raw objects.
+- Cleanup ETA under one minute reads "<1m" instead of "0m".
+
 ## [2.6.51] - 2026-06-11
 
 ### Fixed

docker-compose.yml

@@ -63,7 +63,7 @@ services:
 
   # PixelProbe application
   pixelprobe:
-    image: ttlequals0/pixelprobe:${PIXELPROBE_VERSION:-2.6.51}
+    image: ttlequals0/pixelprobe:${PIXELPROBE_VERSION:-2.6.52}
     container_name: pixelprobe-app
     environment:
       # Security
@@ -131,7 +131,7 @@ services:
 
   # P1 Celery Worker for distributed task processing
   celery-worker:
-    image: ttlequals0/pixelprobe:${PIXELPROBE_VERSION:-2.6.51}
+    image: ttlequals0/pixelprobe:${PIXELPROBE_VERSION:-2.6.52}
     container_name: pixelprobe-celery-worker
     command: python celery_worker.py
     environment:

pixelprobe/services/maintenance_service.py

@@ -45,6 +45,20 @@
 CLEANUP_TASK_TIMEOUT_SECS = env_int('CLEANUP_TASK_TIMEOUT_SECS', 600, floor=60)
 
 
+def forget_task_result(task):
+    """Delete a consumed result from the backend (best-effort).
+
+    Results otherwise live for result_expires (24h): a full-library run leaves
+    1M+ result keys in Redis, driving the noeviction store toward its memory
+    cap - observed live as every broker/backend op slowing ~100x once ~1M
+    files had been processed.
+    """
+    try:
+        task.forget()
+    except Exception:
+        pass
+
+
 def abandon_if_stuck(task_info, timeout_secs, label):
     """Revoke and drop a dispatched task whose result never arrived.
 
@@ -62,6 +76,7 @@ def abandon_if_stuck(task_info, timeout_secs, label):
         task.revoke(terminate=False)
     except Exception:
         pass
+    forget_task_result(task)
     return True
 
 
@@ -451,7 +466,12 @@ def write_cleanup_progress():
                     eta_seconds = avg_time_per_file * (total_files - total_files_processed)
                     eta_hours = int(eta_seconds // 3600)
                     eta_minutes = int((eta_seconds % 3600) // 60)
-                    eta_str = f"{eta_hours}h {eta_minutes}m" if eta_hours > 0 else f"{eta_minutes}m"
+                    if eta_hours > 0:
+                        eta_str = f"{eta_hours}h {eta_minutes}m"
+                    elif eta_minutes > 0:
+                        eta_str = f"{eta_minutes}m"
+                    else:
+                        eta_str = "<1m"
                 else:
                     eta_str = "calculating..."
 
@@ -529,6 +549,8 @@ def write_cleanup_progress():
                         except Exception as e:
                             logger.error(f"Error processing existence check result: {e}")
                             total_files_processed += 1
+                        finally:
+                            forget_task_result(task)
                     elif abandon_if_stuck(task_info, CLEANUP_TASK_TIMEOUT_SECS, 'existence-check'):
                         # Abandoned work counts as unverifiable - NEVER deleted
                         files_abandoned += 1
@@ -1007,6 +1029,8 @@ def write_progress_snapshot(set_heartbeat: bool):
                                 })
                         except Exception as e:
                             logger.error(f"Error getting task result: {e}")
+                        finally:
+                            forget_task_result(task)
                     elif abandon_if_stuck(task_info, INTEGRITY_TASK_TIMEOUT_SECS, 'integrity'):
                         files_abandoned += 1
                     else:

pixelprobe/version.py

@@ -4,7 +4,7 @@
 # Default version - this is the single source of truth
 
 
-_DEFAULT_VERSION = '2.6.51'
+_DEFAULT_VERSION = '2.6.52'
 
 
 # Allow override via environment variable for CI/CD, but default to the hardcoded version

static/js/app.js

@@ -3385,7 +3385,23 @@ class PixelProbeApp {
             detailsHtml += `<tr><th>Duration:</th><td>${report.duration_formatted || 'N/A'}</td></tr>`;
 
             if (report.directories_scanned && Array.isArray(report.directories_scanned) && report.directories_scanned.length > 0) {
-                detailsHtml += `<tr><th>Directories:</th><td>${report.directories_scanned.join('<br>')}</td></tr>`;
+                // Cleanup and file-changes reports store file lists (objects with
+                // file_path/change_type) in this field; scan reports store paths
+                const label = report.scan_type === 'cleanup' ? 'Orphaned Files:'
+                    : report.scan_type === 'file_changes' ? 'Changed Files:'
+                    : 'Directories:';
+                const maxEntries = 100;
+                const entries = report.directories_scanned.slice(0, maxEntries).map(entry => {
+                    if (entry && typeof entry === 'object') {
+                        const path = entry.file_path || JSON.stringify(entry);
+                        return escapeHtml(entry.change_type ? `${path} (${entry.change_type})` : path);
+                    }
+                    return escapeHtml(String(entry));
+                });
+                if (report.directories_scanned.length > maxEntries) {
+                    entries.push(`... and ${report.directories_scanned.length - maxEntries} more`);
+                }
+                detailsHtml += `<tr><th>${label}</th><td>${entries.join('<br>')}</td></tr>`;
             }
 
             detailsHtml += '</table>';