chore(replay-vision): add quality tab docs#72902
Closed
arnohillen wants to merge 3 commits into
Closed
Conversation
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
arnohillen
requested review from
a team,
TueHaulund,
fasyy612 and
ksvat
and removed request for
a team
July 22, 2026 13:52
Contributor
🤖 CI reportℹ️ Docs preview — preview build triggeredDocs from this PR will be published at posthog.com.
The preview should be ready in about 10 minutes. Open the preview at |
…y prompts Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note
Superseded by PostHog/posthog.com#18803. The Replay Vision docs section lives in the posthog.com repo (
contents/docs/replay-vision/), so the page moved there to sit with its siblings and get a sidebar entry.Problem
Replay vision's Quality tab (rate scanner results, feedback themes, ratings-over-time, AI configuration recommendations with test-before-apply) has no user-facing documentation yet. With the feature rolling out, users need a page explaining the rating loop and what each panel does.
Changes
Adds a first docs page at
docs/published/docs/session-replay/replay-vision/quality.md, which publishes toposthog.com/docs/session-replay/replay-vision/qualityon merge.The page covers:
Screenshots were taken from a local dev environment with Hedgebox demo data only (no customer data) and are hosted on
PostHog/pr-assets. Happy to re-host on Cloudinary if that's preferred for posthog.com docs.TODO before merge
demo-fresh-*) and uniform confidence values. Use a scanner with real-looking sessions.Preview of the page's hero image:
How did you test this code?
Docs-only change, no code paths affected. I verified the copy against the implementation (
products/replay_vision/frontend/replay_scanners/components/ScannerQualityTab.tsx,scannerQualityLogic.ts, andbackend/prompt_suggestions.py) so each described behavior matches what ships: default unrated filter, daily recommendation refresh, per-version accuracy attribution, evaluation outcome labels, and quota charging for test re-runs.Automatic notifications
Docs update
This PR is itself the docs update.
🤖 Agent context
Autonomy: Human-driven (agent-assisted)
I (well, Claude Code) wrote the page after reading the Quality tab frontend and the prompt-suggestion backend, then captured the screenshots with a Playwright script against a local dev stack seeded with Hedgebox demo data (dev banners hidden, light theme, retina scale), uploaded via
hogli pr:upload-image. Decisions: placed the page underdocs/published/docs/(the monorepo path that publishes to posthog.com, following the existing surveys precedent) rather than the posthog.com repo, and used pr-assets image URLs as a first version pending Cloudinary hosting. No repo skills were applicable (docs-only, no migrations/DRF/tests).