Commit 1df75cd
feat(ai): enhance RAG with Milvus integration, query rewrite, multi-path retrieval and refactor (#1458)
* refactor(ai): reorganize RAG components with multi-path retrieval and merge
- Reorganize RAG components into indexers, retrievers, loaders, mergers, rerankers, and query packages
- Add Milvus multi-path retrieval support (Dense, BM25 Sparse, Hybrid)
- Add RRF (Reciprocal Rank Fusion) merge layer with deduplication
- Add score normalization strategies (MinMax, ZScore, Rank, Softmax, Sigmoid, Log)
- Add comprehensive Milvus unit tests and E2E workflow tests
- Fix deduplication to handle documents without IDs using content hash
- Fix Milvus SDK dependency compatibility with Go 1.25+
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
* feat(ai): enhance RAG with query rewrite, multi-path retrieval and merge
- Add query rewrite processor for enhanced query optimization
- Implement multi-path retrieval with merge capabilities
- Add comprehensive E2E tests for RAG workflows
- Enable query processor by default in config
- Add RAG test helpers and utilities
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* chore: add AI_CHANGES_SUMMARY.md to gitignore
* chore: remove AI_CHANGES_SUMMARY.md
---------
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>1 parent f8152d5 commit 1df75cd
56 files changed
Lines changed: 11085 additions & 1549 deletions
File tree
- ai
- component
- rag
- indexers
- loaders
- mergers
- query
- rerankers
- retrievers
- test
- tools/engine
- config
- schema/json
- stub/etcd-server-v3
- server/v3
- test/e2e
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
47 | 47 | | |
48 | 48 | | |
49 | 49 | | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
0 commit comments