Instructions to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF", dtype="auto")

sentence-transformers

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF")

sentences = [
    "The weather is lovely today.",
    "It's so sunny outside!",
    "He drove to the stadium."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

llama-cpp-python

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF",
	filename="Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_M.gguf",
)

llm.create_chat_completion(
	messages = "\"Today is a sunny day and I will get some ice cream.\""
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Ollama:
```
ollama run hf.co/mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
```

Unsloth Studio

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF to start chatting

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Run Hermes

hermes

Atomic Chat new
Docker Model Runner
How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Docker Model Runner:
```
docker model run hf.co/mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M
```

Lemonade

How to use mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mradermacher/Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.Mursit-Embed-Qwen3-1.7B-TR-i1-GGUF-Q4_K_M

List all available models

lemonade list

mradermacher commited on Jan 23

Commit

4095171

verified ·

1 Parent(s): 4fbc16a

uploaded from rich1

Browse files

Files changed (25) hide show

.gitattributes +24 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XS.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XXS.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XS.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XXS.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_NL.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_XS.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_L.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_0.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_1.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_M.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_S.gguf +3 -0
Mursit-Embed-Qwen3-1.7B-TR.i1-Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 Mursit-Embed-Qwen3-1.7B-TR.imatrix.gguf filter=lfs diff=lfs merge=lfs -text

 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 Mursit-Embed-Qwen3-1.7B-TR.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Mursit-Embed-Qwen3-1.7B-TR.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0da9ee22094d96f1227e32940b4cffd3eefd2f8b9e544871b938258dda5162a5
+size 543794848

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ1_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a6ea26c686e4a129dd970ce2b17fd482f2e5cfedc3d3d27308bc8e71c9ee5a3f
+size 515778208

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a566da1ad44d0e0f705b071d7db0ea4c1a2bf4e73145f798532a9e9842474f2c
+size 695183008

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f2c815038ea45069a398f93cf3c5953fd6ac1274bbb8ef94d3bc25503f222966
+size 657827488

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f7a801ed9b8cdf8f01cd4227037664dd53c22aa1f2c36296a5e5779d7c6b95c3
+size 631514784

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ2_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aa2106aee6ed245b01e399accd0866bbe6fc1cc6ef71b59f7fd69dff6ba7abb0
+size 590489248

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7831878eb140883c2cbec5c61fee19db60cd1ad989fdb63c7df63c9ba06c0248
+size 895663776

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:471b5857d41b2f19eea1a415afee80fac218ea96666440daa52756874b3d5301
+size 867253920

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7ecebc145b715b58769c5898b305264f4fed2e09ca7f6b0a7942b92aa1039445
+size 834223776

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ3_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8443acdc87692896aeb154f0039b79552b71f02b8808c5416ed7e7163955c810
+size 754362016

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_NL.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8595daa90ccf2088f64efeca846bd0c23a43940734e66e4b1d3034029ea21af9
+size 1054424736

Mursit-Embed-Qwen3-1.7B-TR.i1-IQ4_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:decb19ceeccec3beecee687d6ad33cf4e079e852a80e68c2878645de80b300fe
+size 1010384544

Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e377243f89567c6db8fcf3f605916c6898b6ff6ff947c7504458046239fea2a
+size 777797280

Mursit-Embed-Qwen3-1.7B-TR.i1-Q2_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7f11416a4ae988a49c55a221fe066430e2515749aa94cd9de85df8d87803ec8b
+size 732970656

Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_L.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a76fe75084a94996763fa0db3ef1dd4225bc39c87ce36c65e3b7d37dfcdcd088
+size 1003503264

Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:21baaee353d5610c2910825b49b5c7321bc98c46f5594c55bebaf265c9e31196
+size 939540128

Mursit-Embed-Qwen3-1.7B-TR.i1-Q3_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:632e92f586ed21d5a9223750403bbda6a53e17c0ffa1b4899b5476d50b5e0a96
+size 867253920

Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:eaf1cb5fd27005711607a7ba56a761b338fe0811905b4e015635185a4c6722e5
+size 1056784032

Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_1.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:93358edb8d95e79804f5c1c09da493736f2ddd7823ba5dd8ab411de6d8b13f2c
+size 1142505120

Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f069337b60998bce0a53725c1b3ffc93cdad236362c2a75fb81831b52bb42a15
+size 1107410592

Mursit-Embed-Qwen3-1.7B-TR.i1-Q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5dfaaf5346ad1f98d3aaf5b8b45d1b95d6acc0c8513d2104ea4554cec371ea4
+size 1060191904

Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:65835cca6bd88478baa548a40a5ee6267b884616c8c05e3355fe95e79644f1d0
+size 1257881248

Mursit-Embed-Qwen3-1.7B-TR.i1-Q5_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8d9f5b5be2c3267d4d00ea9046b288d10c9805d1725ef9196d0c59d1cc4701c9
+size 1230585504

Mursit-Embed-Qwen3-1.7B-TR.i1-Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1fba926b790936e781364014d5c0721f87d65f05414a322be23913acd3f69df
+size 1417756320