Skip to content

[github-actions] Validate published reports HTML with proof-html #178

@coisa

Description

@coisa

Summary

The reports workflow already verifies that published main and preview URLs respond after deployment, but it does not yet validate the rendered HTML itself. We should add proof-html validation for both the production reports site and pull-request previews so broken links, malformed markup, and publication regressions are caught closer to deploy time.

Current Behavior

  • reports.yml deploys the main site and PR previews to GitHub Pages.
  • The workflow performs post-deploy health checks against the published URLs.
  • Those checks confirm availability, but they do not validate the published HTML documents and link graph.

Expected Behavior

After a successful deploy, the workflow SHOULD run https://github.com/anishathalye/proof-html against the published site contents for both main and preview deployments. Validation failures SHOULD fail the workflow clearly, while temporary transport or GitHub Pages propagation issues SHOULD remain handled by the existing deployment verification steps.

Scope

Investigate and implement proof-html validation for:

  • the main published reports site
  • pull-request preview reports sites
  • any workflow summaries or docs updates needed to explain the new validation step

Acceptance Criteria

  • reports.yml validates published main-site HTML with proof-html after deployment verification succeeds.
  • reports.yml validates pull-request preview HTML with proof-html after preview verification succeeds.
  • The validation target and invocation are deterministic and compatible with GitHub Actions.
  • Validation failures surface clearly in logs and fail the workflow.
  • Existing deploy health checks remain in place for propagation and availability verification.
  • README or docs are updated if maintainers need to understand the new validation behavior.

Non-Goals

  • Replacing the existing availability and deployment health checks.
  • Validating unpublished local build artifacts instead of the published GitHub Pages output.
  • Adding automatic retries for genuine HTML validation failures.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationenhancementNew feature or request

    Type

    Projects

    Status

    Released

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions