`SupabaseBucketDownloader`

[davidsbatista]

Implement SupabaseBucketDownloader, a component analogous to the existing S3Downloader that fetches files from Supabase Storage buckets and returns them as ByteStream objects for use in indexing pipelines.

Detailed design

from haystack_integrations.components.fetchers.supabase import SupabaseBucketDownloader

downloader = SupabaseBucketDownloader(
    supabase_url="https://<project>.supabase.co",
    supabase_key=Secret.from_env_var("SUPABASE_SERVICE_KEY"),
    bucket_name="my-documents",
)

Implementation notes

• Primary dependency: supabase-py
• Auth via supabase_url and supabase_key (using Secret for secure handling)
• Output: list of ByteStream objects compatible with Haystack file converters (e.g. PyPDFToDocument, HTMLToDocument)
• Take S3Downloader as the reference implementation for interface design
• Support listing and filtering files within a bucket (e.g. by prefix or file extension)
• Integration lives in integrations/supabase/

Checklist

• The code is documented with docstrings and was merged into a feature branch

[sjrl]

Hey @davidsbatista just as a heads up the S3Downloader is meant for use in query pipelines that eventually send images to a vision LLM which is why it's run method takes in Documents and output Documents.

run
run(documents: list[Document]) -> dict[str, list[Document]]

Download files from AWS S3 Buckets to local filesystem.

Return enriched Documents with the path of the downloaded file.

Parameters:

documents (list[Document]) – Document containing the name of the file to download in the meta field.
Returns:

dict[str, list[Document]] – A dictionary with:
documents: The downloaded Documents; each has meta['file_path'].