Skip to content

bug with array struct field when copying from duckdb to vortex #6125

Description

@uwemaurer

What happened?

I have this small (1kb) data file which causes a crash when I try to export it to vortex.

D load vortex;
D describe select * from 'test.json';
┌─────────────┬───────────────────────────────────────────────────────────────────┬─────────┬─────────┬─────────┬─────────┐
│ column_name │                            column_type                            │  null   │   key   │ default │  extra  │
│   varchar   │                              varchar                              │ varchar │ varchar │ varchar │ varchar │
├─────────────┼───────────────────────────────────────────────────────────────────┼─────────┼─────────┼─────────┼─────────┤
│ stats       │ STRUCT(v DOUBLE, country STRUCT("key" VARCHAR, "value" DOUBLE)[]) │ YES     │ NULL    │ NULL    │ NULL    │
└─────────────┴───────────────────────────────────────────────────────────────────┴─────────┴─────────┴─────────┴─────────┘
D copy ( select * from 'test.json') to 'test.vortex' (format vortex);
memory allocation of 2012518595690544 bytes failed
Aborted (core dumped)

test.json

Steps to reproduce

see above

Environment

  • vortex extension: dae36cd
  • duckdb 1.4.3

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugA bug issue

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions