Skip to content

Cannot reshape array... #4

@ckuethe

Description

@ckuethe

Various models are unable to run, and throw an error about inability to reshape:

Loading model: models--mlx-community--AceReason-Nemotron-7B-4bit/snapshots/dc544c28df4ec2d529abac6f6e3566f635d6e7f8
  what():  [reshape] Cannot reshape array of size 3584 into shape (1,1,31666,128).

Loading model: models--mlx-community--Devstral-Small-2505-4bit-DWQ/snapshots/2332d2ec22a6a115b65e2ab1c312a32efb92c71a
  what():  [reshape] Cannot reshape array of size 4096 into shape (1,1,32594,0).

Loading model: models--mlx-community--Falcon3-10B-Instruct-1.58bit-4bit/snapshots/688732a92a31fc826449fdb04e87cd75bbdbe87d
  what():  [reshape] Cannot reshape array of size 768 into shape (1,1,28930,0).

Loading model: models--mlx-community--Llama-OuteTTS-1.0-1B-4bit/snapshots/3ac2cff406f7de16a3216c60d0108571a916acc0
  what():  [reshape] Cannot reshape array of size 2048 into shape (1,1,29234,0).

Loading model: models--mlx-community--Mellum-4b-base/snapshots/c0719eb465ac28f5c19a685b88c2c173347a8b22
  what():  [reshape] Cannot reshape array of size 3072 into shape (1,1,29378,1055929248).

Loading model: models--mlx-community--QwQ-32B-4bit/snapshots/0e98026e38d9957ffdabff95384fd9ee096bb10d
  what():  [reshape] Cannot reshape array of size 5120 into shape (1,1,32642,128).

Loading model: models--mlx-community--codegemma-7b-it-4bit/snapshots/59210ff70e9186fcb9de296e6d56e330318af2bf
  what():  [reshape] Cannot reshape array of size 4096 into shape (1,1,32766,0).

b1006, rocm 7.12, gfx1151

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions