---
language:
  - en
license: apache-2.0
library_name: llama-cpp
tags:
  - gguf
  - vision
  - multimodal
  - forkjoin-ai
base_model: Qwen/Qwen2.5-VL-7B-Instruct
pipeline_tag: image-text-to-text
---

# Qwen2.5 Vl 7B Instruct

Forkjoin.ai conversion of [Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) to GGUF format for edge deployment.

## Model Details

- **Source Model**: [Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)
- **Format**: GGUF
- **Converted by**: [Forkjoin.ai](https://forkjoin.ai)

## Usage

### With llama.cpp

```bash
./llama-cli -m Qwen_Qwen2.5-VL-7B-Instruct-Q4_K_M.gguf -p "Your prompt here" -n 256
```

### With Ollama

Create a `Modelfile`:
```
FROM ./Qwen_Qwen2.5-VL-7B-Instruct-Q4_K_M.gguf
```

```bash
ollama create qwen2.5-vl-7b-instruct-gguf -f Modelfile
ollama run qwen2.5-vl-7b-instruct-gguf
```

## About Forkjoin.ai

[Forkjoin.ai](https://forkjoin.ai) runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.

All conversions are optimized for edge deployment within browser and mobile memory constraints.

## License

Apache 2.0 (follows upstream model license)