How to insert binary data into Clickhouse?

[pentlander]

Question

My Clickhouse schema has some binary data (in this case fixnum 16 UUIDs) that I want to insert from Vector. The Clickhouse sink doesn't support this because the binary data ends up getting converted into a UTF-8 string in the json output. Clickhouse supports ingesting invalid UTF-8 strings in json strings to allow binary data, but the serialization Vector performs doesn't allow this. What would be the best way right now to ingest binary data into Clickhouse? I'd rather not do HTTP sink + protobuf as that adds yet another config to keep track of.

Vector Config

No response

Vector Logs

No response

[pront]

Hi @pentlander, #24595 tracks this issue. The workaround you mentioned is the way to go until the issue is resolved.