| title |
|
||||||||
|---|---|---|---|---|---|---|---|---|---|
| description | Add guardrails to existing applications using the Python SDK, LangChain, or HTTP API. | ||||||||
| topics |
|
||||||||
| tags |
|
||||||||
| content |
|
The NeMo Guardrails library provides the following tools to integrate guardrails into your applications.
-
Use the NeMo Guardrails Python SDK to add guardrails directly into your Python application.
from nemoguardrails import LLMRails, RailsConfig config = RailsConfig.from_path("path/to/config") rails = LLMRails(config) # Use in your application response = rails.generate(messages=[...])
-
Use the NeMo Guardrails LangChain integration capabilities to wrap guardrails around LangChain chains or use chains within guardrails.
from nemoguardrails.integrations.langchain.runnable_rails import RunnableRails guardrails = RunnableRails(config) chain_with_guardrails = prompt | guardrails | model | output_parser
For more information, refer to the LangChain Integration Guide.
-
Integrate the NeMo Guardrails API server into your application to add protection to applications in any programming language.
nemoguardrails server --config path/to/configs
You can then use the API server in your application by sending requests to the server's endpoint.
curl -X POST http://localhost:8000/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "config_id": "content_safety", "messages": [{"role": "user", "content": "Hello!"}] }'
-
Use the NeMo Guardrails Docker deployment capabilities to deploy guardrails as a containerized service. For more information, refer to .
For more examples and detailed integration patterns, refer to the examples directory in the NeMo Guardrails GitHub repository.