Image-Text-to-Text
Transformers.js
ONNX
qwen3_vl
webgpu
interpretability
attention-steering
conversational
Instructions to use baulab/Qwen3-VL-2B-Instruct-GazeHeads-AllLayers-ONNX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use baulab/Qwen3-VL-2B-Instruct-GazeHeads-AllLayers-ONNX with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-text-to-text', 'baulab/Qwen3-VL-2B-Instruct-GazeHeads-AllLayers-ONNX');
Qwen3-VL-2B-Instruct β Gaze-Head Steering, ALL LAYERS (ONNX, WebGPU)
Same as baulab/Qwen3-VL-2B-Instruct-GazeHeads-ONNX
but with every transformer layer decomposed, so the gaze_head_mask /
gaze_sign steering inputs are honored for all 448 attention heads
(28 layers x 16 heads), not just the gaze-hosting layers. Used for the
interactive demo control conditions (steer all heads / random heads).
Two extra decoder inputs implement the paper intervention (zeros = original):
gaze_head_mask(28, 16) float16 β 1.0 selects a head to steergaze_sign(total_seq_len,) float16 β additive pre-softmax attention bias
Inference is slower than the 7-layer build (all layers use decomposed attention instead of fused GroupQueryAttention). Weight data is bit-identical to the upstream export; only the decoder graph differs.
- Downloads last month
- 191
Model tree for baulab/Qwen3-VL-2B-Instruct-GazeHeads-AllLayers-ONNX
Base model
Qwen/Qwen3-VL-2B-Instruct