Skip to content

Commit 06d81aa

Browse files
committed
feat(config): add rope_temporal_size parameter
P1: support configurable temporal size for RoPE - None (default): use actual frame count from input - int value: fixed temporal size (e.g., 64 for legacy behavior)
1 parent 420e6fb commit 06d81aa

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

onevision_encoder/configuration_onevision_encoder.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -77,6 +77,7 @@ def __init__(
7777
attention_dropout=0.0,
7878
initializer_range=0.02,
7979
rope_theta=10000.0,
80+
rope_temporal_size=None,
8081
use_head=True,
8182
**kwargs,
8283
):
@@ -94,4 +95,5 @@ def __init__(
9495
self.attention_dropout = attention_dropout
9596
self.initializer_range = initializer_range
9697
self.rope_theta = rope_theta
98+
self.rope_temporal_size = rope_temporal_size # None=use actual frames, int=fixed size (legacy: 64)
9799
self.use_head = use_head

0 commit comments

Comments
 (0)