Skip to content

Commit 46f6905

Browse files
committed
Remove superfluous guardrails section | replaced by PayloadProcessingPipeline
Signed-off-by: usize <mofoster@redhat.com>
1 parent 49ebb83 commit 46f6905

1 file changed

Lines changed: 9 additions & 48 deletions

File tree

docs/plans/ai-gateway.md

Lines changed: 9 additions & 48 deletions
Original file line numberDiff line numberDiff line change
@@ -459,54 +459,15 @@ certificate count for visibility into how many CAs are trusted.
459459

460460
### Future: guardrails
461461

462-
Content filtering, prompt injection detection, and PII redaction are
463-
per-provider concerns — trust boundaries differ between a local Ollama
464-
instance and an external API endpoint. The natural home for guardrails
465-
is inline on the provider definition, as an ordered processing pipeline:
466-
467-
```yaml
468-
providers:
469-
- name: openai
470-
endpoint: https://api.openai.com/v1
471-
schema: OpenAI
472-
credentials: ...
473-
processing: # future — not in initial scope
474-
- name: pii-redaction
475-
phase: request
476-
extProc:
477-
serviceRef:
478-
name: pii-service
479-
port: 50051
480-
- name: toxicity-check
481-
phase: response
482-
extProc:
483-
serviceRef:
484-
name: toxicity-service
485-
port: 50051
486-
487-
- name: ollama
488-
endpoint: http://ollama.svc:11434
489-
schema: OpenAI
490-
# no processing — trusted local endpoint
491-
```
492-
493-
The `processing` list is ordered, giving pipeline semantics. The
494-
controller would generate per-route ext-proc filter chains so that
495-
different providers get different processing.
496-
497-
The WG AI Gateway's [Proposal 7: Payload Processing] defines a
498-
`PayloadProcessingPipeline` CRD for ordered body/header processors as
499-
HTTPRoute filters. When that proposal matures into an accepted API, the
500-
`processing` field should generate `PayloadProcessingPipeline` resources
501-
rather than raw ext-proc configuration. This follows the same principle
502-
as routing: the user-facing spec stays stable while the generated
503-
resources change as standards evolve.
504-
505-
Gateway-wide guardrails (compliance requirements that apply regardless
506-
of provider) are a separate concern. If needed, a future
507-
`AIGuardrailsPolicy` could attach to the Gateway using the same policy
508-
attachment pattern as AIAccessPolicy. That would be a separate design
509-
proposal.
462+
Content filtering, prompt injection detection, PII redaction, and
463+
semantic caching are payload processing concerns that could apply at
464+
a per-provider or per-model level — trust boundaries differ between
465+
a local Ollama instance and an external API endpoint. The WG AI
466+
Gateway's [Proposal 7: Payload Processing] defines
467+
`PayloadProcessingPipeline` as the standard for this capability.
468+
How we attach processing pipelines to our abstraction is discussed
469+
in [Future: PayloadProcessingPipeline](#future-payloadprocessingpipeline)
470+
below.
510471

511472
Not in scope for the initial implementation.
512473

0 commit comments

Comments
 (0)