Skip to content

Consider switching from DataField to DecimalDataField in outputFormat=parquet #596

Description

@runejo

Our current parquet file does not contain metadata on decimals, and different parquet viewers show a different numbers of decimals.

In PX we have several keyword for this

The parquet file is written using Parquet.Net and the values are of type DataField.
There is also a DecimalDataField I think we should consider.

There are specialised versions for DataField allowing to specify more precise metadata about certain parquet data type, for instance DecimalDataField allows to specify precision and scale other than default values.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Fields

    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions