Currently a null value in a dictionary array fails record batch deserialization with the following error:
Err(Error: Null for non-nullable type: dictionaries do not support nullable values
Even though it's a little odd, nullable values are supported by dictionary arrays and are produced by datafusion.
The docs for the logical_nulls method says this:
For most array types, this is equivalent to the “physical” nulls returned by Array::nulls. It is different for the following cases, because which elements are null is not encoded in a single null buffer:
It would be great if this library supported serializing these null values.
Currently a null value in a dictionary array fails record batch deserialization with the following error:
Even though it's a little odd, nullable values are supported by dictionary arrays and are produced by datafusion.
The docs for the logical_nulls method says this:
It would be great if this library supported serializing these null values.