Skip to content

Improve bookkeeping logging and performance#197

Merged
eflumerf merged 20 commits into
developfrom
eflumerf/LoggingAndPerformance
Apr 21, 2026
Merged

Improve bookkeeping logging and performance#197
eflumerf merged 20 commits into
developfrom
eflumerf/LoggingAndPerformance

Conversation

@eflumerf
Copy link
Copy Markdown
Contributor

No description provided.

Comment thread rc/control/bookkeeping.py Fixed
…sion character class'

Co-authored-by: Copilot Autofix powered by AI <223894421+github-code-quality[bot]@users.noreply.github.com>
@eflumerf eflumerf requested review from ron003 and rrivera747 April 17, 2026 19:43
@eflumerf eflumerf moved this from 📋 Triage to 👍 PR Created in art-daq Work Tracker Apr 20, 2026
Copy link
Copy Markdown
Contributor

@rrivera747 rrivera747 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me - Calorimeter ran with these changes with minimal issues.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR focuses on improving observability and speeding up DAQInterface “bookkeeping” by adding more granular timing logs and reducing repeated/expensive computations during FHiCL document processing.

Changes:

  • Add timestamped debug logging to process-launch and transition-sending paths.
  • Optimize bookkeeping_for_fhicl_documents_artdaq_v3_base via precompiled regexes, memoization, and hoisting repeated lookups.
  • Parallelize private-network discovery across hosts using a thread pool.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
rc/control/manage_processes_direct.py Adds timestamp prefixes to selected debug logs during launch on a host.
rc/control/daqinterface.py Adds elapsed-time debug logging around per-process transition sending.
rc/control/bookkeeping.py Major performance refactor: precompiled regexes, caching, reduced repeated scans, parallel network discovery, and additional timing logs.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread rc/control/bookkeeping.py
Comment thread rc/control/bookkeeping.py Outdated
Comment thread rc/control/bookkeeping.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@eflumerf eflumerf merged commit df5427b into develop Apr 21, 2026
10 checks passed
@eflumerf eflumerf deleted the eflumerf/LoggingAndPerformance branch April 21, 2026 13:05
@github-project-automation github-project-automation Bot moved this from 👍 PR Created to 🎉 Done in art-daq Work Tracker Apr 21, 2026
@eflumerf eflumerf moved this to 🎉 Done in art-daq Work Tracker Apr 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: 🎉 Done

Development

Successfully merging this pull request may close these issues.

5 participants