Skip to content

CHANGELOG.md

Latest commit

 

History

History
262 lines (159 loc) · 12.8 KB

CHANGELOG.md

File metadata and controls

262 lines (159 loc) · 12.8 KB

Changelog

All notable changes to the Monte Carlo Agent Toolkit plugin for Claude Code will be documented in this file.

Format follows Keep a Changelog. This project uses Semantic Versioning.

[1.12.0] - 2026-05-20

Added

  • New /manage-mac skill: create, edit, validate, and import Monitors-as-Code YAML files — CLI-first: uses montecarlo monitors compile to validate and apply to deploy; falls back to MC MCP tools then manual validation
  • Schema validation gates injected into monitoring-advisor and tune-monitor — agents now validate generated YAML against the published schema before presenting it to the user

[1.11.1] - 2026-05-13

Added

  • Add MC_PREVENT_HOOKS_DISABLED=1 env var to disable prevent hooks (block-edit, pre-commit, turn-end) for users who want the skills without the gating behavior.

Changed

  • Clarify telemetry disclosure in plugin README: explicit opt-out instructions and confirmation that no prompts/arguments/code are sent.
  • Polish plugin.json metadata for Anthropic plugin directory submission (expanded description, author.email, homepage).
  • Add "category": "monitoring" to the marketplace.json entry.

[1.11.0] - 2026-05-07

Added

  • Instrument Agent skill — walks Monte Carlo Agent Observability customers through instrumenting a new Python AI agent for Monte Carlo. Detects AI libraries in the codebase, proposes the Monte Carlo OpenTelemetry SDK install with matching instrumentors, generates tracing setup tailored to serverless or long-running runtimes, suggests where workflow and task decorators belong, and verifies traces appear in Monte Carlo. Always asks before editing any file.
    • Invoke via the /instrument-agent slash command or by asking to "instrument my agent" / "set up Monte Carlo tracing".

[1.10.5] - 2026-05-11

Changed

  • 1b2f114 fix(hooks): replace lib symlinks with real file copies (#82)
  • 39c4dd6 AI-256: analyze-root-cause runs TSA first when an incident UUID is present (#79)

[1.10.4] - 2026-05-08

Fixed

  • Skill-usage telemetry hook now only beacons for mc-agent-toolkit skills. Previously it fired for every Skill tool invocation, including skills from other plugins.

[1.10.3] - 2026-05-06

Changed

  • Internal tracking only: anonymous skill-usage telemetry and MCP route updated to /mcp/toolkit. No prompts, args, or file paths sent. Disable telemetry with MC_AGENT_TOOLKIT_TELEMETRY_DISABLED=1. See the plugin README for details.

[1.10.2] - 2026-05-05

Changed

  • Correct alert_assessment output field descriptions in automated-triage skill: replace the stale "natural-language summary" reference with explicit alert_description (what happened) and triage_summary (scoring reasoning) fields, and clarify that alert_description is used in triage comments for untroubleshot alerts.

[1.10.1] - 2026-04-30

Removed

  • SessionStart welcome hook — reported as too noisy.

[1.10.0] - 2026-04-28

Added

  • /mc-validate run subcommand — extends the Monte Carlo Prevent skill's validation workflow to actually execute the generated queries. /mc-validate alone still generates the validation SQL as before; /mc-validate run additionally builds the changed model into your dev database (dbt build --select <model>) and runs the validation queries through the Snowflake MCP, reporting per-query verdicts against each query's "What to look for" guidance.
  • Workflow 4 (sandbox build) in the Prevent skill — parses profiles.yml, classifies the active database as personal/dev/shared-dev/prod/unknown, detects hard-coded database: kwargs in model {{ config() }} blocks, and runs dbt build --select <model>. Hard-stops against shared prod. Skipped automatically for YAML-only diffs.
  • Workflow 5 (execute validation) in the Prevent skill — substitutes <YOUR_DEV_DATABASE> with the user-confirmed value, shows the full execution plan (including any literal prod databases referenced for parity checks), enforces read-only before execution, runs each query via Snowflake MCP, and produces ✅/⚠️/🔴 per-query verdicts plus a consolidated summary.
  • Five new sandbox helper scripts under skills/prevent/scripts/sandbox/: parse_profiles.py, classify_sandbox.py, detect_hardcoded_db.py, substitute_placeholders.py, readonly_check.py. All independently tested (48 pytest cases) and composable via CLI-emitted JSON.
  • Session markers MC_BUILD_RAN and MC_VALIDATE_RAN for hook coordination across the new workflows.

Changed

  • Workflow 3 (generate validation queries) now always ends by offering /mc-validate run as the next step, regardless of how it was triggered.

[1.9.0] - 2026-04-27

Changed

  • Slim the prevent skill: delegate Workflow 1 (table health check) to monte-carlo-asset-health and Workflow 6 (add monitor) to monte-carlo-monitoring-advisor. Remove the alert-triage workflow entirely.
  • Renumber the impact-assessment and validation-query workflows to W2 and W3. Workflow numbers 4 and 5 are reserved for sandbox-build and execute-validation steps from the in-flight mc-validate run work.
  • Single-line description field in skills/prevent/SKILL.md per the ≤250-char authoring rule.
  • Drop alert-mutation tools (updateAlert, setAlertOwner, createOrUpdateAlertComment) from the prevent skill's MCP tool table — those belong to the incident-response peer skill.

Fixed

  • Clear the MC_MONITOR_GAP cache marker after the post-edit / pre-commit prompt has been delivered, so subsequent prompts don't re-nag for the same gap (Python hooks and OpenCode TS hooks).

[1.8.2] - 2026-04-23

Changed

  • monitoring-advisor: hardened the create_*_monitor_mac guidance against the top failure modes seen in production over the last 7 days (70 events across 14 categories). Changes span data-monitor-creation.md (domain-uuid resolution, warehouse-UUID requirement, column-verification gate, enum discipline, table existence check) and the per-type references (alert_condition shape constraints in data-validation-monitor, metric-name and operator-enum corrections in data-metric-monitor / data-custom-sql-monitor, change-threshold documentation in data-custom-sql-monitor, datetime-type requirement for aggregate_time_field, arg-shape constraints in data-table-monitor and data-validation-monitor, predicate/field-type semantics in data-validation-monitor, threshold_value requirement clarification in data-comparison-monitor). See PR #66 for the full error → fix mapping.

Fixed

  • scripts/bump-version.sh normalizes drifted plugin versions. Before this release, claude-code was at 1.8.1 while codex/copilot/cursor/opencode were stuck at 1.7.0 because the script's sed only matched the claude-code version. The non-monotonic 1.7.0 → 1.8.2 jump on those four plugins is intentional — they caught up to the canonical version in this PR. Future bumps stay in sync automatically.

[1.8.1] - 2026-04-20

Fixed

  • Plugin update failed on 1.8.0 with commands path not found for incident-response and proactive-monitoring. The 1.8.0 manifest declared these command paths but the directories were never committed. Added the missing /monte-carlo-incident-response and /monte-carlo-proactive-monitoring slash-command files so the paths resolve and the workflows documented in /mc are actually invokable.

[1.8.0] - 2026-04-20

Added

  • context-detection skill that routes ambiguous data-related asks to the right workflow by probing available MCP tools
  • incident-response workflow skill that runs a root-cause investigation for a reported alert or incident
  • proactive-monitoring workflow skill that walks users from "what should I monitor?" to concrete monitor creation
  • /mc catalog command
  • SessionStart welcome hook — a minimal one-line greeting triggered only when a dbt project or montecarlo.yml is detected in the workspace
  • when_to_use frontmatter on the new workflow skills so the router has explicit trigger examples

[1.7.1] - 2026-04-17

Changed

  • feat(automated-triage): add mark_event_as_normal guidance and scope interactive triage by domain/audience

[1.7.0] - 2026-04-17

Changed

  • Add tune-monitor skill for monitor noise reduction analysis

[1.6.1] - 2026-04-16

Changed

  • Add connection-auth-rules skill for building Connection Auth Rules configs

[1.6.0] - 2026-04-16

Changed

  • Consolidate monitor-creation, agent-monitoring, and monitoring-advisor into a single monitoring-advisor skill
  • Add data-monitor-creation.md and agent-monitor-creation.md mid-level creation procedures
  • Move per-type references with data-/agent- prefixes and distribute constraints
  • Fix MCP tool names to snake_case across all skill docs
  • Update trigger evals: direct monitor creation and agent monitoring now trigger this skill

[1.5.0] - 2026-04-15

Changed

  • Add asset-health skill (#33)
  • Add AI agent monitoring to monitoring-advisor skill (#48)

[1.4.0] - 2026-04-14

Changed

  • c4842c4 fix: add missing skill registrations — READMEs, symlinks, and sync rules (#46)
  • 647669a feat: add automated-triage skill (#40)
  • 9477ae1 feat: add analyze-root-cause skill for incident investigation (#37)

[1.3.0] - 2026-04-14

Changed

  • f46cdfb Add remediation skill for investigating and fixing data quality alerts (#39)
  • c5dd6a5 feat: add agent-monitoring skill and plugin (AI-167) (#35)
  • 9884442 feat: add storage cost analysis and performance diagnosis skills (#36)

[1.2.0] - 2026-04-13

Changed

  • f40f262 fix: add --force flag to release script to skip branch check
  • 9155214 fix: release script PR flow + awk multiline bug
  • ad388c7 fix: register monitoring-advisor as plugin command + add trigger evals (#38)
  • 9147282 K2-287: add monitoring-advisor skill (#34)
  • 930a745 feat: add prevent trigger evals and shared eval runner (#29)
  • cf09cb8 fix: add missing name field to generate-validation-notebook SKILL.md (#32)
  • 44f85ab Add monitor-creation skill and wire into all editor plugins (#31)
  • 6bc245d fix: correct marketplace add command to use repo name (#30)
  • e8597c9 fix: improve release script post-run message (#28)

[1.1.0] - 2026-04-08

Added

  • Monitor Creation skill — guides AI agents through creating Monte Carlo monitors correctly with validation, field-type compatibility checks, and monitors-as-code YAML generation. Covers metric, validation, custom SQL, comparison, and table monitors.

[1.0.0] - 2026-04-07

Changed

  • Restructure from three separate plugins (mc-prevent, mc-generate-validation-notebook, mc-push-ingestion) to unified mc-agent-toolkit plugin
  • All skills, commands, hooks, and config merged into a single plugin directory
  • Hooks namespaced under hooks/prevent/ for multi-skill support
  • Commands namespaced under commands/<skill>/
  • MCP server and permissions configured once at plugin root

Upgrade instructions

Claude Code treats this as a new plugin. Existing users must uninstall old plugins and install the new one:

# 1. Uninstall old plugins
claude plugin remove mc-prevent
claude plugin remove mc-generate-validation-notebook
claude plugin remove mc-push-ingestion

# 2. Install the unified plugin
/plugin install mc-agent-toolkit@mc-marketplace

History prior to the unified toolkit restructure (mc-prevent plugin only):

[1.0.0-prevent] - 2026-04-01

Changed

  • Rename plugin from mc-safe-change to mc-prevent
  • Rename skill from monte-carlo-safe-change to monte-carlo-prevent
  • Reset version to 1.0.0 as a fresh identity

Entries below predate the rename from mc-safe-change to mc-prevent.

[1.1.2] - 2026-03-30

Changed

  • Migrate MCP server from header-based auth (npx mcp-remote + env vars) to zero-config HTTP/OAuth
  • Plugin now bundles .mcp.json with HTTP transport — no manual key setup required
  • Auto-approve MCP tool calls via permissions.allow for both plugin-bundled and standalone server prefixes
  • Update all setup docs to OAuth-first flow; legacy header-based auth moved to collapsible fallback sections

Fixed

  • Use permissions.allow instead of allowedTools in settings.json (was silently ignored)
  • Restore commands field in plugin.json (accidentally removed in initial branch)
  • Track plugin .mcp.json in git via .gitignore negation rule

[1.1.1] - 2026-03-30

Fixed

  • Session cache is now keyed per Claude Code session ID, preventing state from leaking across sessions

[1.1.0] - 2026-03-26

Added

  • Hook-based enforcement for dbt model edits (pre-edit gate, post-edit accumulator, turn-end validation prompt, commit gate)
  • /mc-validate slash command for explicit validation
  • Shared lib: dbt model detection, session cache, fail-open decorator
  • Monte Carlo MCP server wiring

[1.0.0-initial] - 2026-03-22

  • Initial plugin shell with skill file and manifest