schema: align all artifact-type required_sections with template H2s

Brings scripts/helix_validate_artifact_meta.py to green across 47
artifact types.

Renames — required_section now matches the H2 already in template.md:
- opportunity-canvas: go_nogo_checklist -> go_no_go_decision
- product-vision: value_propositions -> key_value_propositions
- compliance-requirements: drop regulatory_landscape_analysis;
  data_classification -> data_classification_and_handling
- threat-model: stride_analysis -> stride_threat_analysis
- architecture: system_context/container_diagram ->
  level_1_system_context/level_2_container_diagram
- data-architecture: quality_contracts/governance_and_access/
  databricks_platform_design -> pipeline_level_quality_contracts/
  governance_and_access_control/platform_design
- story-test-plan: acceptance_criteria_mapping ->
  acceptance_criteria_test_mapping
- deployment-checklist: go_no_go -> go_or_no_go_decision

Drops — H3-level entries the validator (H2-only) cannot see; prompt
and template still enforce H3 substructure:
- pr-faq: 14 H3 subsections -> the 4 H2 anchors
- feature-specification: FR/NFR H3s -> Requirements H2
- research-plan: drop knowledge_gaps/resource_requirements/
  expected_outcomes; rename success_criteria/risk_assessment to
  completion_criteria/research_risks
- stakeholder-map: drop stakeholder_identification/engagement_strategy/
  escalation_path
- test-plan: test_levels/critical_paths -> testing_strategy/
  acceptance_criteria_layer_allocation
- metrics-dashboard: drop review_window

Validator: skip artifacts where output.format != markdown
(metric-definition is YAML; its schema lives in YAML keys).

Q1 — technical-design stops echoing AC (ADR-009):
- Remove ## Acceptance Criteria H2 from template + example
- Drop story_reference/acceptance_criteria_review/definition_of_done;
  rename testing_approach -> testing
- Quality check is now acceptance_criteria_realized (AC-IDs, no text)
- Automated check requires US-{n}-AC{m} references
- Example illustrates the pattern in the Testing section

Gates: validator OK (47/47), lint-prose 0/0/0, generator drift OK,
link check 73,351/73,351, redundancy OK.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

Author: easel

docs/website/content/artifact-types/design/technical-design.md

@@ -0,0 +1,56 @@
+---
+title: "Databricks Platform Substitution Reference"
+slug: databricks-platform-substitution
+generated: true
+---
+# Databricks Platform Substitution Reference
+
+If you are adopting HELIX data artifacts (`data-prd`, `data-architecture`,
+`data-quality-expectations`) on a platform other than Databricks, substitute
+the platform-specific terms below. The artifact templates and prompts stay
+the same; only the named platform features change.
+
+## Catalog / Governance
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| Unity Catalog (UC) hierarchy (metastore → catalog → schema → volume/table) | Database + Schema + Table | Project + Dataset + Table | Database + Schema |
+| UC fine-grained access (row filters, column masks) | Row-access policies + masking policies | Authorized views + column-level security | Database views, RLS extensions |
+| UC lineage | Object dependencies + Account Usage | Data lineage in Dataplex | Manual lineage in dbt/Marquez |
+
+## Ingestion / Streaming
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| Auto Loader (incremental cloud-file ingestion) | Snowpipe or native connectors | Dataflow, BigQuery Connector Hub, Streaming Inserts | Apache NiFi, Kafka connectors |
+| Streaming Tables (declarative streaming with EXPECT) | Stream-triggered materialized views + native checks | Dataflow with Beam assertions | Apache Flink with custom state management |
+| Spark Structured Streaming | Snowflake streams + tasks | Dataflow | Apache Spark / Flink |
+
+## Orchestration / Pipelines
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| Databricks Workflows / Jobs | Snowflake Tasks | Cloud Composer (Airflow) or Cloud Workflows | Apache Airflow, Dagster, dbt Cloud |
+| Delta Live Tables / SDP pipeline orchestration | Dynamic Tables | Dataform | dbt, Dagster assets |
+
+## Quality / Contracts
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| SDP `EXPECT ... ON VIOLATION ...` | Data Quality checks + Task error handling | BigQuery Data Quality API + Cloud Workflows | dbt tests, Great Expectations, custom assertions |
+| SDP Genie test generation | dbt auto-generate tests from table samples | BigQuery Data Catalog insights | dbt, custom metadata scanning |
+| Lakeview dashboards (quality monitoring) | Snowflake Dashboards | Looker, Data Studio | Grafana, custom dashboards |
+
+## Storage / Formats
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| Delta Lake format | Iceberg or proprietary formats | Native BigQuery tables | Apache Parquet, Iceberg, Hudi |
+| Medallion layers (Bronze / Silver / Gold) | Same pattern applies universally | Same pattern applies universally | Same pattern applies universally |
+
+## Compute / Cost
+
+| Databricks Concept | Snowflake Equivalent | BigQuery Equivalent | On-Prem / Other |
+|---|---|---|---|
+| DBU budget estimation | Credit consumption | On-demand or flat-rate pricing | Compute resource allocation |
+| All-purpose / Jobs / Serverless SQL compute tiers | Warehouses (XS through 6XL) | On-demand vs reservation slots | Cluster sizing |

docs/website/content/research/databricks-platform-substitution.md

@@ -40,6 +40,33 @@ def extract_h2_slugs(template_path: Path) -> list[str]:
     return slugs
 
 
+def extract_output_format(meta_path: Path) -> str | None:
+    """Extract `output.format` from a HELIX meta.yml, or None if absent.
+
+    The validator's H2-vs-required_sections check only applies to markdown
+    artifacts. YAML artifacts (metric-definition, etc.) declare their schema
+    by YAML keys, not template H2s, so they are skipped.
+    """
+    text = meta_path.read_text(encoding="utf-8").splitlines()
+    in_output = False
+    for line in text:
+        if re.match(r"^output\s*:\s*$", line):
+            in_output = True
+            continue
+        if in_output:
+            if line and not line.startswith((" ", "\t")) and ":" in line:
+                return None
+            m = re.match(r"^\s+format\s*:\s*(.+?)\s*$", line)
+            if m:
+                value = m.group(1).strip()
+                if (value.startswith('"') and value.endswith('"')) or (
+                    value.startswith("'") and value.endswith("'")
+                ):
+                    value = value[1:-1]
+                return value
+    return None
+
+
 def extract_required_sections(meta_path: Path) -> list[str] | None:
     """Parse out validation.required_sections from a HELIX meta.yml.
 
@@ -127,6 +154,11 @@ def validate(art_dir: Path) -> list[str]:
     template_path = art_dir / "template.md"
     failures: list[str] = []
 
+    # Skip non-markdown artifacts: their schema lives in YAML keys, not H2s.
+    fmt = extract_output_format(meta_path)
+    if fmt and fmt.lower() != "markdown":
+        return failures
+
     required = extract_required_sections(meta_path)
     if not required:
         return failures  # no required_sections declared, nothing to check

scripts/helix_validate_artifact_meta.py

@@ -22,7 +22,7 @@ validation:
     - solution_concept
     - key_metrics
     - unfair_advantage
-    - go_nogo_checklist
+    - go_no_go_decision
 
   quality_checks:
     - check: problem_validated

workflows/activities/00-discover/artifacts/opportunity-canvas/meta.yml

@@ -22,7 +22,7 @@ validation:
     - vision
     - user_experience
     - target_market
-    - value_propositions
+    - key_value_propositions
     - success_definition
     - why_now
 

workflows/activities/00-discover/artifacts/product-vision/meta.yml

@@ -17,9 +17,9 @@ output:
 
 validation:
   required_sections:
-    - regulatory_landscape_analysis
+    - applicable_regulations
     - compliance_requirements_matrix
-    - data_classification
+    - data_classification_and_handling
     - implementation_plan
 
   quality_checks:

workflows/activities/01-frame/artifacts/compliance-requirements/meta.yml

@@ -24,11 +24,10 @@ output:
 validation:
   required_sections:
     - problem_statement
-    - functional_requirements
-    - non_functional_requirements
-    - edge_cases
+    - requirements
+    - edge_cases_and_error_handling
     - success_metrics
-    - constraints
+    - constraints_and_assumptions
     - out_of_scope
 
   quality_checks:

workflows/activities/01-frame/artifacts/feature-specification/meta.yml

@@ -17,22 +17,9 @@ output:
 
 validation:
   required_sections:
+    - press_release
     - internal_product_argument
-    - core_thesis
-    - mechanism
-    - quality_model
-    - decision_autonomy_boundary
-    - press_release_headline
-    - press_release_subhead
-    - press_release_summary
-    - the_problem
-    - the_solution
-    - leader_quote
-    - how_it_works
-    - customer_quote
-    - availability
-    - external_faqs
-    - internal_faqs
+    - faq
     - downstream_projection
 
   quality_checks:

workflows/activities/01-frame/artifacts/pr-faq/meta.yml

@@ -19,13 +19,10 @@ output:
 validation:
   required_sections:
     - research_objectives
-    - knowledge_gaps
     - research_methods
-    - success_criteria
+    - completion_criteria
     - timeline
-    - resource_requirements
-    - risk_assessment
-    - expected_outcomes
+    - research_risks
 
   quality_checks:
     - check: objectives_measurable

workflows/activities/01-frame/artifacts/research-plan/meta.yml

@@ -18,12 +18,11 @@ output:
 
 validation:
   required_sections:
-    - stakeholder_identification
+    - primary_stakeholders_high_influence_high_interest
+    - secondary_stakeholders_variable_influence_interest
     - raci_matrix
     - power_interest_grid
     - communication_plan
-    - engagement_strategy
-    - escalation_path
 
   quality_checks:
     - check: raci_completeness