Instructions to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with Transformers:

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF", dtype="auto")

llama-cpp-python

How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF",
	filename="MinerU2.5-Pro-2604-1.2B.i1-IQ1_M.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with Ollama:
```
ollama run hf.co/mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
```

Unsloth Studio

How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF to start chatting

Atomic Chat new
Docker Model Runner
How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with Docker Model Runner:
```
docker model run hf.co/mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M
```

Lemonade

How to use mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mradermacher/MinerU2.5-Pro-2604-1.2B-i1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.MinerU2.5-Pro-2604-1.2B-i1-GGUF-Q4_K_M

List all available models

lemonade list

mradermacher commited on Apr 12

Commit

fc3c4d6

verified ·

1 Parent(s): ac3dd2f

uploaded from nico1

Browse files

Files changed (25) hide show

.gitattributes +24 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ1_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ1_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ2_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ2_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ2_XS.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ2_XXS.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ3_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ3_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ3_XS.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ3_XXS.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ4_NL.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-IQ4_XS.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q2_K.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q2_K_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q3_K_L.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q3_K_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q3_K_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q4_0.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q4_1.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q4_K_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q4_K_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q5_K_M.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q5_K_S.gguf +3 -0
MinerU2.5-Pro-2604-1.2B.i1-Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 MinerU2.5-Pro-2604-1.2B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text

 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 MinerU2.5-Pro-2604-1.2B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MinerU2.5-Pro-2604-1.2B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

MinerU2.5-Pro-2604-1.2B.i1-IQ1_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b9089a5319d64f5ef4b70e252547227d17925eb946c3315e2632e1fcab70c542
+size 317973344

MinerU2.5-Pro-2604-1.2B.i1-IQ1_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0ece393eda0f9e08c1a55452fb1b14274d9eacbb216c4de50d0aebfade3c83a
+size 315828320

MinerU2.5-Pro-2604-1.2B.i1-IQ2_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:175541d746aef4dbd8c97d62fd623fc96c8be16f954b6067755b34bdffd2e546
+size 328596320

MinerU2.5-Pro-2604-1.2B.i1-IQ2_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2b0d48b02e3ae647e96e33dd14378ec3b3af91bcb4689de5919e649ca110fb0b
+size 325736288

MinerU2.5-Pro-2604-1.2B.i1-IQ2_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cbece3e5c8b76cfda48f95ef181ba96f519235660fd943ae888f8366d7d199f1
+size 324408416

MinerU2.5-Pro-2604-1.2B.i1-IQ2_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5c8cb3bbad03b11b7497a6d4b0e665759634b6cf968b3a6e0488e6ecaa8b024a
+size 321548384

MinerU2.5-Pro-2604-1.2B.i1-IQ3_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:656a31ed46e188bca6c29c1a4fe8a86d38c8a16cfc5f090ba4d237ace4433597
+size 342751328

MinerU2.5-Pro-2604-1.2B.i1-IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:78d718aac2636fa38855f9affca474c32bdf0dd08cddfb4a3488af6ba0a98e54
+size 338606432

MinerU2.5-Pro-2604-1.2B.i1-IQ3_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5361a34d5eb172b820f683ed46103f2184d6a2410402e9848c4ba8996d5fd972
+size 338606432

MinerU2.5-Pro-2604-1.2B.i1-IQ3_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:635ebcf78da7e6bb7278c602c5f34943d59ec0e97335cd66d6eb0c4e64109a6d
+size 333703520

MinerU2.5-Pro-2604-1.2B.i1-IQ4_NL.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cb2fb51b3996206840e8185831604c461bca2871b1960de6865150be770aa5ef
+size 352670048

MinerU2.5-Pro-2604-1.2B.i1-IQ4_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:26d7d5c304fc84cf41c8bf1ed7321a1305557664b8164d46fda00aa25e955645
+size 349401440

MinerU2.5-Pro-2604-1.2B.i1-Q2_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aacc931094e171429f7d7746c36ef3f319b505f14bc1297408e4a56a40b22544
+size 338606432

MinerU2.5-Pro-2604-1.2B.i1-Q2_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f2e73be95428914257264264fb4fd8b4d5536692d77e06db4e9dbcb24c4735c
+size 331047776

MinerU2.5-Pro-2604-1.2B.i1-Q3_K_L.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5cdd9c82705356585dacebb4fe65529063d0a438f37c3ba23fc86c1eb3c2da23
+size 369357152

MinerU2.5-Pro-2604-1.2B.i1-Q3_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0d5d0c1fdb53a28e69a41bb328d82c647806fcf0dbe13c36157fecffd7aec940
+size 355465568

MinerU2.5-Pro-2604-1.2B.i1-Q3_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf38315dded9d19c11c9449e6bf07141be14e0d9560f8461203b3a5876f984c3
+size 338262368

MinerU2.5-Pro-2604-1.2B.i1-Q4_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9ba8c57cc1bf2817d9afec5cc7d5f686fee7b41b749f3336830fe9117857c10b
+size 352971104

MinerU2.5-Pro-2604-1.2B.i1-Q4_1.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:efa87960ac1764d471f4a529354ceb83bcb3e3d6f91967bad8ae8f33f5138319
+size 374518112

MinerU2.5-Pro-2604-1.2B.i1-Q4_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4b9d97d4caa97f01ef0dd397e7b5d519a644308954fc0ba22755456e5413242a
+size 397806944

MinerU2.5-Pro-2604-1.2B.i1-Q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e3024a36ddb1538b1fd4bba5bbabde57d3dfcd022fc8cd541981292ff8d3f69
+size 385470816

MinerU2.5-Pro-2604-1.2B.i1-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cd8b2c5f1c637cbddd60419460442262dcc1c385cfe84dfe1e7c8415692c7389
+size 420085088

MinerU2.5-Pro-2604-1.2B.i1-Q5_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99e590d899f9e41c2dbb5c58ecd1cc9787f451bb2672f4c9e3b3e5973e0add46
+size 412709216

MinerU2.5-Pro-2604-1.2B.i1-Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d0408dff220c7e2048816305219d549db13d16bdc7232051045137dfdbb1c62e
+size 505735520