How to use from the
Use from the
MLC-LLM library
# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

OmniCoder-9B-q4f16_1-MLC

This is Tesslate/OmniCoder-9B (a coding/agentic fine-tune of Qwen3.5-9B) converted to MLC format with q4f16_1 quantization for in-browser inference via WebLLM (WebGPU) and MLC-LLM.

This repo contains the converted weights + mlc-chat-config.json + tokenizer. It can reuse the existing prebuilt Qwen3.5-9B WebGPU model library (same architecture/dimensions), so no separate model-library upload is needed for the default q4f16_1 / 4096-context setup.

I have separtely included in the lib directory recompiled WASM files for 8k, 16k and 32k context windows.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for belsamber/OmniCoder-9B-q4f16_1-MLC

Finetuned
Qwen/Qwen3.5-9B
Quantized
(23)
this model