Instructions to use vectionlabs/Salience-1.5-Nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vectionlabs/Salience-1.5-Nano with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="vectionlabs/Salience-1.5-Nano") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("vectionlabs/Salience-1.5-Nano") model = AutoModelForMultimodalLM.from_pretrained("vectionlabs/Salience-1.5-Nano", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use vectionlabs/Salience-1.5-Nano with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "vectionlabs/Salience-1.5-Nano" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vectionlabs/Salience-1.5-Nano", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/vectionlabs/Salience-1.5-Nano
- SGLang
How to use vectionlabs/Salience-1.5-Nano with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "vectionlabs/Salience-1.5-Nano" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vectionlabs/Salience-1.5-Nano", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "vectionlabs/Salience-1.5-Nano" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vectionlabs/Salience-1.5-Nano", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use vectionlabs/Salience-1.5-Nano with Docker Model Runner:
docker model run hf.co/vectionlabs/Salience-1.5-Nano
Most small models can talk about your codebase.
Nano works inside it.
Nine billion parameters, dense. Native vision. Native reasoning. A quarter-million tokens of context. Small enough to sit on one consumer GPU and stay there — and built, like everything in the Salience family, around a single question: did the task actually get done?
What it does
Ships patches, not suggestions. Reads before it writes. Finds the cause instead of the symptom, then changes the smallest thing that fixes it.
Lives in a terminal. Plans the sequence, checks the result of each step before taking the next, and recovers from a failure rather than repeating it.
Sees what you see. Screenshots, diagrams, mockups, stack traces in an image — first-class input, not an afterthought.
Thinks without being told to. Reasoning is native and on by default. You never have to write think step by step — and you should not: this model reasons on its own, and asking makes it perform instead.
The family
| Pro | 35B-A3B | the heavy tier |
| Flash | 30B-A3B | multimodal, long horizon |
| Nano | 9B dense | runs on your machine |
Start
from transformers import AutoModelForImageTextToText, AutoTokenizer
repo = "vectionlabs/Salience-1.5-Nano"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForImageTextToText.from_pretrained(repo, dtype="auto", device_map="auto")
messages = [{"role": "user", "content": "Find and fix the off-by-one in this loop: ..."}]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=2048)
print(tok.decode(out[0, inputs.input_ids.shape[1]:], skip_special_tokens=True))
~19 GB in fp16, ~6.5 GB quantized. Pass enable_thinking=False when you want the answer and
not the reasoning.
Specifications
| Parameters | 9.65B dense |
| Modalities | text, image, video to text |
| Context | 262,144 tokens |
| Precision | bfloat16 |
| License | Apache-2.0 |
Nano is small: it will lose to frontier-scale models on the hardest problems, and it can be confidently wrong — verify what matters. Review generated code before running it. Built on Qwen3.5 (Apache-2.0).
- Downloads last month
- 146