Instructions to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M # Run inference directly in the terminal: llama cli -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M # Run inference directly in the terminal: llama cli -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Use Docker
docker model run hf.co/AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with Ollama:
ollama run hf.co/AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
- Unsloth Desktop
- Pi
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with Docker Model Runner:
docker model run hf.co/AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
- Lemonade
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Run and chat with the model
lemonade run user.NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "AMAImedia/NOESIS-Qwopus3.5-9B-Translate-v3.5-BF16:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
NOESIS / AMAImedia
Last updated: 2026-08-29
Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: DHCF-FNO — Deterministic Hybrid Control Framework for Frozen Neural Operators).
- Founder: Ilia Bolotnikov
- Organization: AMAImedia.com
- X (Twitter): @AMAImediacom
- LinkedIn: Ilia Bolotnikov
- Telegram: @djbionicl
- NOESIS version: v16.1
- Release date: 2026-08-26
Language support
This Qwen3.5-derived model follows the official Qwen3 language list below (119 languages and dialects) and the official Qwen3.5 coverage statement of 201 languages and dialects. Qwen3.5 publishes the expanded coverage count but does not provide an exhaustive 201-name enumeration in its model card. The list below is the complete language list published by Qwen for Qwen3 and is included as the transparent, documented baseline for this derivative.
English, French, Portuguese, German, Romanian, Swedish, Danish, Bulgarian, Russian, Czech, Greek, Ukrainian, Spanish, Dutch, Slovak, Croatian, Polish, Lithuanian, Norwegian Bokmål, Norwegian Nynorsk, Persian, Slovenian, Gujarati, Latvian, Italian, Occitan, Nepali, Marathi, Belarusian, Serbian, Luxembourgish, Venetian, Assamese, Welsh, Silesian, Asturian, Chhattisgarhi, Awadhi, Maithili, Bhojpuri, Sindhi, Irish, Faroese, Hindi, Punjabi, Bengali, Oriya, Tajik, Eastern Yiddish, Lombard, Ligurian, Sicilian, Friulian, Sardinian, Galician, Catalan, Icelandic, Tosk Albanian, Limburgish, Dari, Afrikaans, Macedonian, Sinhala, Urdu, Magahi, Bosnian, Armenian; Chinese (Simplified Chinese, Traditional Chinese, Cantonese), Burmese; Arabic (Standard, Najdi, Levantine, Egyptian, Moroccan, Mesopotamian, Ta’izzi-Adeni, Tunisian), Hebrew, Maltese; Indonesian, Malay, Tagalog, Cebuano, Javanese, Sundanese, Minangkabau, Balinese, Banjar, Pangasinan, Iloko, Waray (Philippines); Tamil, Telugu, Kannada, Malayalam; Turkish, North Azerbaijani, Northern Uzbek, Kazakh, Bashkir, Tatar; Thai, Lao; Finnish, Estonian, Hungarian; Vietnamese, Khmer; Japanese, Korean, Georgian, Basque, Haitian, Papiamento, Kabuverdianu, Tok Pisin, Swahili.
Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: DHCF-FNO — Deterministic Hybrid Control Framework for Frozen Neural Operators).
Qwopus3.5-9B-Translate-v3.5-BF16
Role: Dedicated translator (9B). Think-model — for deterministic translation use a
closed-think prefill (<think>\n\n</think>\n\n after assistant\n) to suppress reasoning,
otherwise it emits a reasoning trace instead of the translation.
BF16 = PRIMARY. Sibling: -GGUF-Q4_K_M.gguf (5.24 GB, fits 6GB GPU).
Positioning: In the published FLORES-200 comparison below, this model is the best-performing pure translator among the tested open-source baselines by average COMET (0.8870), chrF++ (50.7), and BLEU (22.5). This benchmark is a limited internal comparison and does not establish that it is the best open-source translation model in the world.
Test results (2026-06-17) — Q4_K_M, FLORES devtest n=20, no-think
| Direction | chrF++ | BLEU |
|---|---|---|
| eng→rus | 54.9 | 25.9 |
| eng→cmn | 32.8 | 7.2 |
| AVG | 43.8 | 16.5 |
Sample (eng→rus): «Теперь у нас есть мыши в возрасте четырёх месяцев, которые ранее страдали диабетом, но сейчас не болеют им», — добавил он.
Comparison (same FLORES n=20)
| Model | Translate AVG chrF++/BLEU | Supervisor-12 |
|---|---|---|
| This (9B-Translate Q4) | 43.8 / 16.5 | 5/12 (not a supervisor) |
| NOESIS-4B-LongCtx Q8 | 41.7 / 16.5 | 11/12 |
| base 4B Q8 | 42.4 / 15.4 | 5/12 |
Best pure translator (marginal: +2.1 chrF++ over the 4B, BLEU tied) but NOT a supervisor. Use 9B for the final translation pass when VRAM allows; the 4B-LongCtx is the all-rounder.
Speed (RTX 3060 Laptop 6GB, GPU, 33/33 layers offloaded)
- Q4_K_M: gen 49.1 tok/s, prompt eval 307 tok/s. (vs 4B-LongCtx Q8: 53.5 / 366 — the 4B is ~9% faster despite the 9B being lighter-per-param in Q4.)
⚠️ n=20 quick estimate (partly within noise). Eval on GPU via llama-completion.exe -ngl 99.
Written: 2026-06-17
MT benchmark — FLORES-200 devtest (2026-06-17)
Real eval (not smoke): n=100 × 4 directions (eng↔rus, eng↔cmn), GPU via resident
llama-server -ngl 99. Primary metric COMET (wmt22-comet-da, neural — how "best
translator" is judged), plus chrF++ / BLEU / length-ratio. Each model prompted in its own
native format (MT2 = dubbing ChatML "SOURCE (lang): … Только перевод"; 9B = ChatML + no-think).
Data + COMET checkpoint: D:/models/by_expert/07_MT_TRANSLATION.
| Model | Size | COMET avg | chrF++ | BLEU | gen tok/s |
|---|---|---|---|---|---|
| Qwopus3.5-9B-Translate Q4 | 5.24 GB | 0.8870 | 50.7 | 22.5 | 49 |
| NOESIS-Hy-MT2-7.5B Q5 | 5.0 GB | 0.8709 | 46.2 | 21.4 | 52 |
| NOESIS-Hy-MT2-1.8B Q8 | 1.78 GB | 0.8481 | 43.9 | 19.1 | 121 |
Per-direction COMET — 9B-Translate wins all 4 (eng-rus .902 / eng-cmn .897 / rus-eng .872 / cmn-eng .877); MT2-7.5B 2nd, MT2-1.8B 3rd.
Notes:
- MT2 is a dubbing translator (isochrony): its outputs are shorter (len_ratio ~0.87-0.89 vs 9B ~1.0) because it compresses to fit speech slots → lower chrF on literal FLORES news. FLORES does NOT measure MT2's slot-fit strength, so it under-rates MT2 for its actual job.
- 1.8B→7.5B degradation: COMET +0.023, chrF +2.3, BLEU +2.3 — modest; 1.8B is 2.4× faster and 2.8× smaller (good lightweight tradeoff).
- BLEU for eng-cmn is low for all (Chinese needs char-tokenization); use chrF++/COMET there.
- Downloads last month
- 501