Skip to content

Commit 2f63e91

Browse files
authored
Merge pull request lightspeed-core#2150 from tisnik/lcore-2933-overview-page
LCORE-2933: Overview page
2 parents 2d136fe + bda8207 commit 2f63e91

4 files changed

Lines changed: 630 additions & 0 deletions

File tree

docs/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,8 @@ See the full documentation at [`../README.md`](../README.md) or browse sub-pages
3333

3434
## Overview
3535

36+
[Overview](https://lightspeed-core.github.io/lightspeed-stack/overview.html)
37+
3638
[Architecture](https://lightspeed-core.github.io/lightspeed-stack/ARCHITECTURE.html)
3739

3840
[Architecture diagram](https://lightspeed-core.github.io/lightspeed-stack/architecture.svg)

docs/index.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,8 @@ product questions using backend LLM services, agents, and RAG databases.
4040

4141
## Overview
4242

43+
[Overview](https://lightspeed-core.github.io/lightspeed-stack/overview.html)
44+
4345
[Architecture](https://lightspeed-core.github.io/lightspeed-stack/ARCHITECTURE.html)
4446

4547
[Architecture diagram](https://lightspeed-core.github.io/lightspeed-stack/architecture.svg)

docs/overview.md

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
# Overview
2+
3+
## Introduction
4+
5+
### What is Lightspeed Core Stack?
6+
7+
**Lightspeed Core Stack (LCore)** is an enterprise-grade middleware service that provides a robust layer between client applications and AI Large Language Model (LLM) backends. It adds essential enterprise features such as authentication, authorization, quota management, caching, and observability to LLM interactions.
8+
9+
Current version of LCore is built on **Llama Stack** - open-source framework that provides standardized APIs for building LLM applications. Llama Stack offers a unified interface for models, RAG (vector stores), tools, and safety (shields) across different providers. LCore communicates with Llama Stack to orchestrate all LLM operations.
10+
11+
To enhance LLM responses, LCore leverages **RAG (Retrieval-Augmented Generation)**, which retrieves relevant context from vector databases before generating answers. Llama Stack manages the vector stores, and LCore queries them to inject relevant documentation, knowledge bases, or previous conversations into the LLM prompt.
12+
13+
### Key Features
14+
15+
- **Multi-Provider Support**: Works with multiple LLM providers (Ollama, OpenAI, Watsonx, etc.)
16+
- **Enterprise Security**: Authentication, authorization (RBAC), and secure credential management
17+
- **Resource Management**: Token-based quota limits and usage tracking
18+
- **Conversation Management**: Multi-turn conversations with history and caching
19+
- **RAG Integration**: Retrieval-Augmented Generation for context-aware responses
20+
- **Tool Orchestration**: Model Context Protocol (MCP) server integration
21+
- **Observability**: Prometheus metrics, structured logging, and health checks
22+
- **Agent-to-Agent**: A2A protocol support for multi-agent collaboration
23+
24+
### Components Overview
25+
26+
![Overview Stack as service](./overview.svg)
27+

0 commit comments

Comments
 (0)