Qwen3-0.6B-Base โ€” ONNX

This repository contains an ONNX Runtime export generated with Optimum from Qwen/Qwen3-0.6B-Base.

Load with Optimum

from optimum.onnxruntime import ORTModelForCausalLM
from transformers import AutoTokenizer

model_id = "Sharjeelbaig/Qwen3-0.6B-Base-ONNX"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = ORTModelForCausalLM.from_pretrained(model_id)

The model was exported with the text-generation-with-past task and validated by ONNX Runtime on CPU.

Downloads last month
329
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Sharjeelbaig/Qwen3-0.6B-Base-ONNX

Quantized
(79)
this model