Skip to content

Commit c9a5bdb

Browse files
pmbrullclaude
andauthored
fix(search): enable vector embeddings on context_memory_search_index (#28374)
Add the embedding fields (fingerprint, textToEmbed, chunkIndex, chunkCount, parentId) to all locale variants of the context_memory mapping and include dataAssetEmbeddings in its parentAliases. Without fingerprint, OsUtils.addKnnVectorSettings() returned early and never injected the knn_vector embedding field; without the alias, vector search at /dataAssetEmbeddings/_search never fanned out to the context memory index. Both gates are now satisfied so ContextMemory participates in semantic search alongside tables, glossary terms, and knowledge pages. Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent dbb0737 commit c9a5bdb

5 files changed

Lines changed: 61 additions & 1 deletion

File tree

openmetadata-spec/src/main/resources/elasticsearch/en/context_memory_search_index.json

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -613,6 +613,21 @@
613613
"extension": {
614614
"type": "flattened"
615615
},
616+
"fingerprint": {
617+
"type": "keyword"
618+
},
619+
"textToEmbed": {
620+
"type": "text"
621+
},
622+
"chunkIndex": {
623+
"type": "integer"
624+
},
625+
"chunkCount": {
626+
"type": "integer"
627+
},
628+
"parentId": {
629+
"type": "keyword"
630+
},
616631
"suggest": {
617632
"type": "completion",
618633
"contexts": [

openmetadata-spec/src/main/resources/elasticsearch/indexMapping.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -615,7 +615,7 @@
615615
"indexName": "context_memory_search_index",
616616
"indexMappingFile": "/elasticsearch/%s/context_memory_search_index.json",
617617
"alias": "contextMemory",
618-
"parentAliases": ["all"],
618+
"parentAliases": ["all", "dataAssetEmbeddings"],
619619
"childAliases": []
620620
}
621621
}

openmetadata-spec/src/main/resources/elasticsearch/jp/context_memory_search_index.json

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -613,6 +613,21 @@
613613
"extension": {
614614
"type": "flattened"
615615
},
616+
"fingerprint": {
617+
"type": "keyword"
618+
},
619+
"textToEmbed": {
620+
"type": "text"
621+
},
622+
"chunkIndex": {
623+
"type": "integer"
624+
},
625+
"chunkCount": {
626+
"type": "integer"
627+
},
628+
"parentId": {
629+
"type": "keyword"
630+
},
616631
"suggest": {
617632
"type": "completion",
618633
"contexts": [

openmetadata-spec/src/main/resources/elasticsearch/ru/context_memory_search_index.json

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -613,6 +613,21 @@
613613
"extension": {
614614
"type": "flattened"
615615
},
616+
"fingerprint": {
617+
"type": "keyword"
618+
},
619+
"textToEmbed": {
620+
"type": "text"
621+
},
622+
"chunkIndex": {
623+
"type": "integer"
624+
},
625+
"chunkCount": {
626+
"type": "integer"
627+
},
628+
"parentId": {
629+
"type": "keyword"
630+
},
616631
"suggest": {
617632
"type": "completion",
618633
"contexts": [

openmetadata-spec/src/main/resources/elasticsearch/zh/context_memory_search_index.json

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -613,6 +613,21 @@
613613
"extension": {
614614
"type": "flattened"
615615
},
616+
"fingerprint": {
617+
"type": "keyword"
618+
},
619+
"textToEmbed": {
620+
"type": "text"
621+
},
622+
"chunkIndex": {
623+
"type": "integer"
624+
},
625+
"chunkCount": {
626+
"type": "integer"
627+
},
628+
"parentId": {
629+
"type": "keyword"
630+
},
616631
"suggest": {
617632
"type": "completion",
618633
"contexts": [

0 commit comments

Comments
 (0)