@@ -459,54 +459,15 @@ certificate count for visibility into how many CAs are trusted.
459459
460460# ## Future: guardrails
461461
462- Content filtering, prompt injection detection, and PII redaction are
463- per-provider concerns — trust boundaries differ between a local Ollama
464- instance and an external API endpoint. The natural home for guardrails
465- is inline on the provider definition, as an ordered processing pipeline :
466-
467- ` ` ` yaml
468- providers:
469- - name: openai
470- endpoint: https://api.openai.com/v1
471- schema: OpenAI
472- credentials: ...
473- processing: # future — not in initial scope
474- - name: pii-redaction
475- phase: request
476- extProc:
477- serviceRef:
478- name: pii-service
479- port: 50051
480- - name: toxicity-check
481- phase: response
482- extProc:
483- serviceRef:
484- name: toxicity-service
485- port: 50051
486-
487- - name: ollama
488- endpoint: http://ollama.svc:11434
489- schema: OpenAI
490- # no processing — trusted local endpoint
491- ` ` `
492-
493- The `processing` list is ordered, giving pipeline semantics. The
494- controller would generate per-route ext-proc filter chains so that
495- different providers get different processing.
496-
497- The WG AI Gateway's [Proposal 7 : Payload Processing] defines a
498- ` PayloadProcessingPipeline` CRD for ordered body/header processors as
499- HTTPRoute filters. When that proposal matures into an accepted API, the
500- ` processing` field should generate `PayloadProcessingPipeline` resources
501- rather than raw ext-proc configuration. This follows the same principle
502- as routing : the user-facing spec stays stable while the generated
503- resources change as standards evolve.
504-
505- Gateway-wide guardrails (compliance requirements that apply regardless
506- of provider) are a separate concern. If needed, a future
507- ` AIGuardrailsPolicy` could attach to the Gateway using the same policy
508- attachment pattern as AIAccessPolicy. That would be a separate design
509- proposal.
462+ Content filtering, prompt injection detection, PII redaction, and
463+ semantic caching are payload processing concerns that could apply at
464+ a per-provider or per-model level — trust boundaries differ between
465+ a local Ollama instance and an external API endpoint. The WG AI
466+ Gateway's [Proposal 7 : Payload Processing] defines
467+ ` PayloadProcessingPipeline` as the standard for this capability.
468+ How we attach processing pipelines to our abstraction is discussed
469+ in [Future : PayloadProcessingPipeline](#future-payloadprocessingpipeline)
470+ below.
510471
511472Not in scope for the initial implementation.
512473
0 commit comments