Instructions to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with Transformers:

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mradermacher/DeepAttriCap-VLA-3B-i1-GGUF", dtype="auto")

llama-cpp-python

How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="mradermacher/DeepAttriCap-VLA-3B-i1-GGUF",
	filename="DeepAttriCap-VLA-3B.i1-IQ1_M.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with Ollama:
```
ollama run hf.co/mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
```

Unsloth Studio

How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/DeepAttriCap-VLA-3B-i1-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/DeepAttriCap-VLA-3B-i1-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for mradermacher/DeepAttriCap-VLA-3B-i1-GGUF to start chatting

Atomic Chat new
Docker Model Runner
How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with Docker Model Runner:
```
docker model run hf.co/mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M
```

Lemonade

How to use mradermacher/DeepAttriCap-VLA-3B-i1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mradermacher/DeepAttriCap-VLA-3B-i1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.DeepAttriCap-VLA-3B-i1-GGUF-Q4_K_M

List all available models

lemonade list

mradermacher commited on Aug 29, 2025

Commit

3694b06

verified ·

1 Parent(s): 252f5a0

uploaded from nico1

Browse files

Files changed (25) hide show

.gitattributes +24 -0
DeepAttriCap-VLA-3B.i1-IQ1_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ1_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ2_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ2_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ2_XS.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ2_XXS.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ3_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ3_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ3_XS.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ3_XXS.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ4_NL.gguf +3 -0
DeepAttriCap-VLA-3B.i1-IQ4_XS.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q2_K.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q2_K_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q3_K_L.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q3_K_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q3_K_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q4_0.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q4_1.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q4_K_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q4_K_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q5_K_M.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q5_K_S.gguf +3 -0
DeepAttriCap-VLA-3B.i1-Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 DeepAttriCap-VLA-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text

 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 DeepAttriCap-VLA-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+DeepAttriCap-VLA-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

DeepAttriCap-VLA-3B.i1-IQ1_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7c98530612efe31613808dcf90eb00f80b7d65b75df5e25ee68c1b5544c3b314
+size 850027808

DeepAttriCap-VLA-3B.i1-IQ1_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:69035589503b140be6ebafecabbded55bb538902d5f5f87a6fd3fc588d7efbe9
+size 791094560

DeepAttriCap-VLA-3B.i1-IQ2_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f19464da99a28b3e543c31db45b16cea3f2ec7bd853c23fa44e1b869bc32974
+size 1140516128

DeepAttriCap-VLA-3B.i1-IQ2_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0bc4114761f659fb589c1f19f586c7d0e1687464f27a5c316440860eed837bee
+size 1061938464

DeepAttriCap-VLA-3B.i1-IQ2_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b2ae8f9ce2ed436c6d51e6b1e53809dd91036b580a2e98b813442d8ca20c83e
+size 1031546144

DeepAttriCap-VLA-3B.i1-IQ2_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:04e257f4c54b3ed5486623cc80c43eff9459496a3af8b6b90dcd9e2697520556
+size 948249888

DeepAttriCap-VLA-3B.i1-IQ3_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cb64339df25827e59d32721ae1897bb64088114c71f1014bcc78b2ed36eef7a4
+size 1488895264

DeepAttriCap-VLA-3B.i1-IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b99d5997d6ebd609a5a87c2bc55a87fa2d413974935117e31c45ec4cadf061f5
+size 1456864544

DeepAttriCap-VLA-3B.i1-IQ3_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a7ce859a0c20ec2a90917e4bb37291ac41546daf8edbd4795ddda832ea9d9b04
+size 1391836448

DeepAttriCap-VLA-3B.i1-IQ3_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aa2d2a1fbdae6cade46248ea577bc66dc7d8e60c9c310f1928b515ab0809c631
+size 1282827552

DeepAttriCap-VLA-3B.i1-IQ4_NL.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a030c31172921ce04c9c386168c51e385dce5619909c5d5fb92d7130024807f
+size 1825209632

DeepAttriCap-VLA-3B.i1-IQ4_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5a7c26eb55ca35389108d6703369f62753d58d24c81fe598aaeb5784b6d2cf43
+size 1739095328

DeepAttriCap-VLA-3B.i1-Q2_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8eed95cdbb2f3165ff795e2a2b227b118a39a21816c3f011d470ff7656d52ba7
+size 1274756384

DeepAttriCap-VLA-3B.i1-Q2_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4f36b93ac6af6b20daf2816ee5777e5882ec3b2f1fe1fabff9260eb14c3f57e
+size 1198128416

DeepAttriCap-VLA-3B.i1-Q3_K_L.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:29e6c1d0dc764556a38a4b1995ddb35bcbd8a997b1081a00f14a9f5414460f79
+size 1707392288

DeepAttriCap-VLA-3B.i1-Q3_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8773244bf11cbf220dd0f4fdd60ee0c046dabe2884ff51297a79af2820cd209
+size 1590476064

DeepAttriCap-VLA-3B.i1-Q3_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:116e4b15ced7ab469267176e5fef4206c12f1557fd4a06c37ea2526ddef38c7b
+size 1454357792

DeepAttriCap-VLA-3B.i1-Q4_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e876735f01e43ec4a051d1cf4ffc345ae975c9214e485f3f74db4ec4d9cfa5d5
+size 1828486432

DeepAttriCap-VLA-3B.i1-Q4_1.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99c138dfa4eb4f11dbc534297c8f514f427a1dda6a0def1fd5df0131a5c0ffff
+size 1996258592

DeepAttriCap-VLA-3B.i1-Q4_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7a568d8e0553bc3d10dd93ee9bc83fe60e5ded567af723d2fae7adc56b0f6df
+size 1929903392

DeepAttriCap-VLA-3B.i1-Q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:eee3922699a7ed9c35f2be83ea12110038a150e4b3e6fd33771ed08c4b872866
+size 1834384672

DeepAttriCap-VLA-3B.i1-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:285d4bdd8779a96c709d48b4cf4147dc7889ed8bc382e1546822dbc9b040f6e1
+size 2224815392

DeepAttriCap-VLA-3B.i1-Q5_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9c679291bb201f5894998a492dc4eb3a5da537565c1763f9c2b5c8ce40a5bce
+size 2169666848

DeepAttriCap-VLA-3B.i1-Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e446c87809d1c2c51c4a8e3528e2cda6729e226cc2cc1f6fea33c74cb6a79051
+size 2538159392