Qwen3-VL-2B-Instruct β€” Gaze-Head Steering, ALL LAYERS (ONNX, WebGPU)

Same as baulab/Qwen3-VL-2B-Instruct-GazeHeads-ONNX but with every transformer layer decomposed, so the gaze_head_mask / gaze_sign steering inputs are honored for all 448 attention heads (28 layers x 16 heads), not just the gaze-hosting layers. Used for the interactive demo control conditions (steer all heads / random heads).

Two extra decoder inputs implement the paper intervention (zeros = original):

  • gaze_head_mask (28, 16) float16 β€” 1.0 selects a head to steer
  • gaze_sign (total_seq_len,) float16 β€” additive pre-softmax attention bias

Inference is slower than the 7-layer build (all layers use decomposed attention instead of fused GroupQueryAttention). Weight data is bit-identical to the upstream export; only the decoder graph differs.

Downloads last month
191
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for baulab/Qwen3-VL-2B-Instruct-GazeHeads-AllLayers-ONNX

Quantized
(83)
this model