test(e2e): route agent e2e through the ci gateway product#3206
Merged
Conversation
Switches the live agent e2e suite from the catch-all `llm_gateway` gateway product to the dedicated `ci` product. Both accept a personal API key (no OAuth mint), so auth is unchanged, but e2e traffic is now attributed to its own `ai_product` bucket. Updates the default gateway URL, run-e2e.sh, and the config docs. Requires the `ci` product added to the llm-gateway in posthog/posthog. Generated-By: PostHog Code Task-Id: bec748f0-776a-4ab6-a4f0-15109b3740df
|
React Doctor found no issues in the changed files. 🎉 Reviewed by React Doctor for commit |
|
Merging to
After your PR is submitted to the merge queue, this comment will be automatically updated with its status. If the PR fails, failure details will also be posted here |
Shortening the default gateway URL to the `ci` product let the expression fit on one line, so biome's formatter wanted it collapsed. Fixes the failing quality check. Generated-By: PostHog Code Task-Id: bec748f0-776a-4ab6-a4f0-15109b3740df
charlesvien
approved these changes
Jul 6, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The live agent e2e suite points at the llm-gateway's catch-all
llm_gatewayproduct. That works, but it mixes e2e traffic in with everything else that falls through to the default bucket, so e2e spend/usage can't be filtered cleanly byai_product.Changes
Switch the e2e suite to the dedicated
cigateway product. Likellm_gateway,ciaccepts a personal API key (no OAuth mint), so auth is unchanged, but traffic is now attributed to its ownai_productbucket.POSTHOG_CODE_E2E_GATEWAY_URLnow points at.../cirun-e2e.shand the e2e README updated to matchDepends on the
ciproduct being registered in the llm-gateway: PostHog/posthog#68767. That should merge (and deploy) first, otherwise a run without an explicitPOSTHOG_CODE_E2E_GATEWAY_URLoverride would 400.How did you test this?
Config and doc change only. The e2e suite needs a live local gateway plus a personal API key, which I (the PostHog Slack app, running Claude) did not run. Verified there are no remaining
llm_gatewayreferences in the e2e dir beyond the one intentional doc note explaining whyciexists.Automatic notifications
Created with PostHog from a Slack thread