Skip to content

[ET-VK][qconv][ez] Make q8ta_im2col shader support stride_w != 1#17386

Merged
meta-codesync[bot] merged 8 commits intogh/SS-JIA/417/basefrom
gh/SS-JIA/417/head
Feb 13, 2026
Merged

[ET-VK][qconv][ez] Make q8ta_im2col shader support stride_w != 1#17386
meta-codesync[bot] merged 8 commits intogh/SS-JIA/417/basefrom
gh/SS-JIA/417/head

Conversation

@SS-JIA
Copy link
Copy Markdown
Contributor

@SS-JIA SS-JIA commented Feb 11, 2026

Stack from ghstack (oldest at bottom):

The im2col path previously had two shaders: the generic q8ta_im2col
which loaded input elements one int8 at a time and supported all strides,
and q8ta_im2col_4w4c which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. input_x_base + i).

This diff replaces both shaders with a single q8ta_im2col that uses
the efficient packed loading approach from q8ta_im2col_4w4c while
generalizing the width offset to input_x_base + i * stride_x. This
removes the stride_w == 1 restriction and deletes the separate
q8ta_im2col_4w4c shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on stride.w == 1 for the im2col path is removed.

Authored with Claude.

Differential Revision: D93000161

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented Feb 11, 2026

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17386

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit db64852 with merge base dcfd12d (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 11, 2026
@github-actions
Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
ssjia and others added 2 commits February 11, 2026 15:12
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
ssjia added 4 commits February 12, 2026 14:23
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
…w != 1"

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)

[ghstack-poisoned]
@meta-codesync meta-codesync Bot merged commit 445c84c into gh/SS-JIA/417/base Feb 13, 2026
196 of 197 checks passed
@meta-codesync meta-codesync Bot deleted the gh/SS-JIA/417/head branch February 13, 2026 16:13
SS-JIA pushed a commit that referenced this pull request Feb 13, 2026
Pull Request resolved: #17386

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.
ghstack-source-id: 340983072
@exported-using-ghexport

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)
SS-JIA pushed a commit that referenced this pull request Feb 13, 2026
Pull Request resolved: #17386

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.
ghstack-source-id: 340983072
@exported-using-ghexport

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)
chizkiyahu pushed a commit to chizkiyahu/executorch that referenced this pull request Feb 23, 2026
Pull Request resolved: pytorch#17386

The im2col path previously had two shaders: the generic `q8ta_im2col`
which loaded input elements one int8 at a time and supported all strides,
and `q8ta_im2col_4w4c` which loaded packed int32s (4 channels at once)
but was restricted to stride_w == 1 because it assumed consecutive
width positions in the input (i.e. `input_x_base + i`).

This diff replaces both shaders with a single `q8ta_im2col` that uses
the efficient packed loading approach from `q8ta_im2col_4w4c` while
generalizing the width offset to `input_x_base + i * stride_x`. This
removes the stride_w == 1 restriction and deletes the separate
`q8ta_im2col_4w4c` shader entirely.

The C++ dispatch is updated to reference the unified shader name, and
the test gate on `stride.w == 1` for the im2col path is removed.

Authored with Claude.
ghstack-source-id: 340983072
@exported-using-ghexport

Differential Revision: [D93000161](https://our.internmc.facebook.com/intern/diff/D93000161/)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants