QDrantDocumentStore serializes plaintext API key when to_dict is called

[mathislucka]

Describe the bug
I noticed this when calling pipeline.dumps but it should be the case when simply calling to_dict on the QDrantDocumentStore as well. The YAML config for the document store will contain a metadata key which holds:

• User-Agent
• api-key

The api-key attribute has the api key (loaded via Secret.from_env_var) in plaintext.

Expected behavior would be that the api key does not get serialized in plain text.

To Reproduce
Create an instance of QDrantDocumentStore and call to_dict

Describe your environment (please complete the following information):

• OS: [e.g. iOS]
• Haystack version:
• Integration version:

[sjrl]

Hey @mathislucka could you provide some example code that causes this issue. I'm checking locally and I'm unable to reproduce currently.

[mathislucka]

from haystack_integrations.document_stores.qdrant import QdrantDocumentStore
from haystack.utils import Secret
from haystack.components.writers import DocumentWriter
from haystack import Pipeline, Document
from haystack.components.embedders.sentence_transformers_document_embedder import SentenceTransformersDocumentEmbedder

from dotenv import load_dotenv

load_dotenv()


def get_pipeline():
    document_store = QdrantDocumentStore(
        url="somecloudinstance",
        index="Document",
        api_key=Secret.from_env_var("QDRANT_API_KEY"),
        embedding_dim=768,
        recreate_index=False,
    )
    writer = DocumentWriter(document_store)
    embedder = SentenceTransformersDocumentEmbedder(model="intfloat/e5-base-v2")

    pp = Pipeline()
    pp.add_component("embedder", embedder)
    pp.add_component("writer", writer)
    pp.connect("embedder", "writer")

    return pp


if __name__ == "__main__":
    pipeline = get_pipeline()
    pipeline.run({"documents": Document(content="test")})
    str_yaml = pipeline.dumps()

[mathislucka]

I'm also running the doc store in between (which causes client initialization) maybe that's what was missing?

[mathislucka]

Updated the example accordingly

[sjrl]

@mathislucka thanks for the additional context! I was able to reproduce when running a local version of QDrant using docker. If using the in memory version this issue doesn't occur.

I'll continue to investigate what's going on

[sjrl]

@mathislucka new version with the fix has been released https://pypi.org/project/qdrant-haystack/9.1.2/