Search results

[CUDA] Deterministic token-doubling / corrupted output on H200 (Hopper sm_90); CPU clean

ep:CUDA

Status: Open.

#2291 In microsoft/onnxruntime-genai;

· justinchuby opened on Jul 12, 2026

Gemma-4 E2B multimodal (ORT-GenAI) eval vs HF PyTorch: quality-parity findings + per_layer_inputs release note

Status: Open.

#2288 In microsoft/onnxruntime-genai;

· justinchuby opened on Jul 9, 2026

Running in nvidia agx orin jetpack7.2

Status: Open.

#2283 In microsoft/onnxruntime-genai;

· BenjeKi opened on Jul 9, 2026

Gemma3ForCausalLM ONNX export produces garbage output for certain prompts (Persian, and any prompt triggering Gemma3's known "massive activation" pattern) - divergence traced to layer 0 (sliding-attention) output

Status: Open.

#2277 In microsoft/onnxruntime-genai;

· ehsanrs2 opened on Jul 7, 2026

Crash on Android: Ort::InitApi() aborts because libonnxruntime.so resolves to the Linux build, not the Android AAR

platform:mobile

Status: Open.

#2243 In microsoft/onnxruntime-genai;

· ihassantariq opened on Jun 26, 2026

no_repeat_ngram_size search option is parsed but never applied

Status: Open.

#2241 In microsoft/onnxruntime-genai;

· mustjab opened on Jun 25, 2026

Building with WinML on Windows

platform:windows

Status: Open.

#2231 In microsoft/onnxruntime-genai;

· RyanMetcalfeInt8 opened on Jun 16, 2026

ModelBuilder support use_cache=False and hidden_states_layers

Status: Open.

#2217 In microsoft/onnxruntime-genai;

· huisunCompiler opened on Jun 11, 2026

Data-dependent bidirectional mask (Gemma-4 vision-block) forces standard Attention over GQA — split prefill/decode decoder graphs?

Status: Open.

#2204 In microsoft/onnxruntime-genai;

· justinchuby opened on Jun 9, 2026

Support suppress_tokens / begin_suppress_tokens (HF generation parity)

Status: Open.

#2201 In microsoft/onnxruntime-genai;

· justinchuby opened on Jun 8, 2026

Feature request : Support for SmolVLM2

Status: Open.

#2197 In microsoft/onnxruntime-genai;

· singhanianish opened on Jun 8, 2026

Gemma4 Per-Layer Embedding: Architecture Analysis & Alternatives

Status: Open.

#2149 In microsoft/onnxruntime-genai;

· justinchuby opened on May 8, 2026