Instructions to use unsloth/Qwen3.6-27B-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use unsloth/Qwen3.6-27B-NVFP4 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Qwen3.6-27B-NVFP4 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Qwen3.6-27B-NVFP4 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/Qwen3.6-27B-NVFP4 to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/Qwen3.6-27B-NVFP4", max_seq_length=2048, )
Anyone experienced degraded image multimodal result?
#6
by azidanit - opened
Result this NVFP4 weight
Based on the visual content, this image appears to be a split-screen meme or graphic with a distinct, low-poly 3D aesthetic. Here is a breakdown of what is in it:
**Visual Style:**
The image has the look of a rough 3D render or a screenshot from a video game (like *Garry's Mod* or a similar sandbox game). The figures look like generic 3D mannequins or models with flat shading and a grainy texture.
**Left Panel:**
* **Subject:** A 3D figure (appearing to be a man) is standing with his arms crossed or held in front of him.
* **Background:** Behind him is a large vehicle, likely a van or truck. The letters **"NYPD"** are visible on the side of the vehicle, suggesting a New York Police Department vehicle.
* **Text:** Superimposed over the figure is the text:
> USING GOOGLE
> TO RESPOND
> TO THE REVIEW
**Right Panel:**
* **Subject:** A similar 3D figure is standing in what looks like a doorway or an interior room. They appear to be reaching for a door handle or opening a door.
* **Background:** There is a window or door frame visible on the right wall.
* **Text:** The exact same text is superimposed over this figure:
> USING GOOGLE
> TO RESPOND
> TO THE REVIEW
**Overall Context:**
The image seems to be a humorous or nonsensical caption, possibly implying that someone is using Google to look up reviews (perhaps of a police department or a building) in a very literal or robotic way. The repetition of the text and the identical visual style suggests it might be a template used for memes.
Result Qwen3.6 27B FP8
This is a meme based on a scene from the 1994 *Spider-Man* animated series, often called the "Spider-Man Pointing at Spider-Man" meme.
Here is a breakdown of the image:
* **Visuals:** It shows two versions of Spider-Man pointing their fingers at each other. The Spider-Man on the left is standing outside next to an NYPD van. The Spider-Man on the right is standing inside a room.
* **Text:**
* The text over the left Spider-Man reads: **"USING CLAUDE TO REVIEW CODE"**
* The text over the right Spider-Man reads: **"USING CLAUDE TO RESPOND TO CODE REVIEW"**
**The Meaning:**
The meme is a joke about software developers using the AI model "Claude" (by Anthropic) for two opposite sides of the coding process. It suggests a cycle where a developer uses AI to critique their code, and then immediately uses that same AI to write the defense or fixes for those critiques."
Setup Sglang 0.5.13
no quantized KV cache (bf16)
update:
I just found out using this ENV causing the degradation for multimodalSGLANG_USE_CUDA_IPC_TRANSPORT: "1"
after set it to SGLANG_USE_CUDA_IPC_TRANSPORT: "0" its works just fine.
the output for the same prompt image using this NVFP4 weight:
This image is a meme based on the popular "Spider-Man Pointing" template (often used to show two people accusing each other of the same thing).
**Visual Description:**
* **Left Side:** Spider-Man is standing in front of an NYPD van, pointing his finger to the right. The text overlaid on him reads: **"USING CLAUDE TO REVIEW CODE"**
* **Right Side:** Another Spider-Man is pointing back to the left. The text overlaid on him reads: **"USING CLAUDE TO RESPOND TO CODE REVIEW"**
**Meaning:**
The meme is a joke about software development workflows and artificial intelligence. It references **Claude**, a popular AI language model.
The humor comes from the idea that developers are now using AI for both sides of a conversation:
1. One developer uses AI to automatically generate reviews for someone else's code.
2. The other developer uses AI to automatically write responses to those reviews.
Essentially, it depicts a scenario where "AI is talking to AI," highlighting how deeply AI is becoming integrated into the coding process."
