Skip to content

docs: add OpenSpec 2026-06-30 Oobee improvements specs#772

Draft
younglim wants to merge 1 commit into
masterfrom
docs/openspec-crawler-specs
Draft

docs: add OpenSpec 2026-06-30 Oobee improvements specs#772
younglim wants to merge 1 commit into
masterfrom
docs/openspec-crawler-specs

Conversation

@younglim

Copy link
Copy Markdown
Collaborator

Initialize OpenSpec in the project and capture critical web-crawling and report-generation behaviors from commits since 8cf8f9d into formal normative specifications.

Change name: 2026-06-30-oobee-improvements

New capability specs:

  • crawl-rate-control: budget enforcement, adaptive concurrency, circuit breaker
  • sitemap-resilience: discovery, XSL-safe fetch, image exclusion, accounting
  • auth-header-isolation: scoped auth, CORS safety, header rewrite minimization
  • redirect-boundary-enforcement: URL normalization, hostname equivalence, robots.txt
  • custom-flow-guard-overlay: loop prevention, overlay continuity, closed-page safety
  • report-artifact-resilience: retry accounting, EPERM tolerance, JSONL integrity

This PR adds...

  • I've kept this PR as small as possible (~500 lines) by splitting it into PRs with manageable chunks of code
  • I've requested reviews from 1 reviewer
  • I've tested existing features (website scan, sitemap, custom flow) in both node index and cli
  • I've synced this fork with GovTechSG repo
  • I've added/updated unit tests
  • I've added/updated any necessary dependencies in package[-lock].json npm audit, portable installation on GitHub Actions

Initialize OpenSpec in the project and capture critical web-crawling
and report-generation behaviors from commits since 8cf8f9d into
formal normative specifications.

Change name: 2026-06-30-oobee-improvements

New capability specs:
- crawl-rate-control: budget enforcement, adaptive concurrency, circuit breaker
- sitemap-resilience: discovery, XSL-safe fetch, image exclusion, accounting
- auth-header-isolation: scoped auth, CORS safety, header rewrite minimization
- redirect-boundary-enforcement: URL normalization, hostname equivalence, robots.txt
- custom-flow-guard-overlay: loop prevention, overlay continuity, closed-page safety
- report-artifact-resilience: retry accounting, EPERM tolerance, JSONL integrity
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant