Skip to content

con-ai-reference-and-tool-calling-capabilities-through.adoc

Latest commit

 

History

History
32 lines (20 loc) · 1.11 KB

con-ai-reference-and-tool-calling-capabilities-through.adoc

File metadata and controls

32 lines (20 loc) · 1.11 KB

AI reference and tool-calling capabilities through {lcs-name}

Review the core components managed by the {lcs-name}({lcs-short}) sidecar container to plan integrations with large language models (LLM) and tool runtime providers.

The {lcs-short} container deploys as a sidecar to extend {product-very-short} functionality. The container integrates and manages the following core architectural components:

  • Large language model (LLM) inference providers

  • Model Context Protocol (MCP) or Retrieval Augmented Generation (RAG) tool runtime providers

    Important

    You must verify that your model supports tool calling before you enable MCP features. Using an incompatible model results in error messages.

  • Safety providers

  • Vector database settings

{lcs-short} also manages critical operational configuration and key data, specifically:

  • User feedback collection

  • MCP server configuration

  • Chat history

{ls-short} sends prompts and receives LLM responses through the {lcs-short} sidecar.