Huihui-Kimi-K2.5-BF16-abliterated-GGUF

Instructions to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF", dtype="auto")

llama-cpp-python

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF",
	filename="Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf",
)

llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": [
				{
					"type": "text",
					"text": "Describe this image in one sentence."
				},
				{
					"type": "image_url",
					"image_url": {
						"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
					}
				}
			]
		}
	]
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
# Run inference directly in the terminal:
llama-cli -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
# Run inference directly in the terminal:
llama-cli -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
# Run inference directly in the terminal:
./llama-cli -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
# Run inference directly in the terminal:
./build/bin/llama-cli -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Use Docker

docker model run hf.co/lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

LM Studio
Jan

vLLM

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

SGLang

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Ollama
How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Ollama:
```
ollama run hf.co/lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
```

Unsloth Studio

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF to start chatting

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Run Hermes

hermes

Atomic Chat new
Docker Model Runner
How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Docker Model Runner:
```
docker model run hf.co/lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K
```

Lemonade

How to use lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull lhca521/Huihui-Kimi-K2.5-BF16-abliterated-GGUF:Q2_K

Run and chat with the model

lemonade run user.Huihui-Kimi-K2.5-BF16-abliterated-GGUF-Q2_K

List all available models

lemonade list

lhca521

bakosh commited on Apr 15

Commit

e62d646

0 Parent(s):

Duplicate from bakosh/Huihui-Kimi-K2.5-BF16-abliterated-GGUF

Browse files

Co-authored-by: q <bakosh@users.noreply.huggingface.co>

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +138 -0
Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf +3 -0
Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf +3 -0
Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf +3 -0

.gitattributes ADDED Viewed

	@@ -0,0 +1,138 @@

+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00061-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00009-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00010-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00011-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00012-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00013-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00014-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00015-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00016-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00017-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00018-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00019-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00020-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00021-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00022-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00023-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00024-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00025-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00026-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00027-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00028-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00029-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00030-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00031-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00032-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00033-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00034-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00035-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00036-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00037-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00038-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00039-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00040-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00041-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00042-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00043-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00044-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00045-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00046-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00047-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00048-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00049-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00050-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00051-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00052-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00053-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00054-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00055-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00056-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00057-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00058-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00059-of-00061.gguf filter=lfs diff=lfs merge=lfs -text
+Q3_K-GGUF/Q3_K-GGUF-00060-of-00061.gguf filter=lfs diff=lfs merge=lfs -text

Q2_K-GGUF/Q2_K-GGUF-00001-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6be9a7614f4405eeea30dbd4c043b7c199fd1ecb7460ac91041a87dfc8ade1d7
+size 7768241152

Q2_K-GGUF/Q2_K-GGUF-00002-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:eb8292456324fc3c8bbf353ca0c80f246c1a412e1b5e2935cfba5ee304bcdcd3
+size 8617252736

Q2_K-GGUF/Q2_K-GGUF-00003-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cca563f437ef1796af2414ab25a8643a5807041191cfbd10f82f660d103cf74a
+size 9948949728

Q2_K-GGUF/Q2_K-GGUF-00004-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2091884b203d05c2e511972e175fb37bced8716e20ac8bb0f76b70aa0c2c5e04
+size 8617252736

Q2_K-GGUF/Q2_K-GGUF-00005-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:374d11215e15ce040358bbe47b933bb6e9591902dcd20f867c02e9a7ed880235
+size 9948949728

Q2_K-GGUF/Q2_K-GGUF-00006-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e48cece1028496f4e4f8279bb93a7a5aa6d8d8c496ed8cc2dd0b519723974dbf
+size 8617252736

Q2_K-GGUF/Q2_K-GGUF-00007-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3622e120912cac6afbdf698b20bf2d2c4ffc567c74fa6ceef47bac46c1712311
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00008-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a04b78b04433386c30083d08273a4cbaa47a7ac37f85ea118fe260ccccff192
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00009-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:105ac05c6b88aafff778aacc436a5678bc9de1419a77ebdbe5437658768bcc1e
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00010-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:01816af0079690d7b234e06f8dd4f908c3e3426c7c1411a41ec9f5fa75c686fd
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00011-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1edf98a37d627507a4362aaf4e3204f62054f2b68ed5138b9d1e386846cf0d7e
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00012-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a0ec3a67ced9e5b1b64a857112b035adf7abc61ddb894875b241927a1e393cee
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00013-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1499d94b103562620f3d3e11e997a1f5ffbcae3342d8c56bd87be8ea61b4b74b
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00014-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:058f00a21c21d9e29daade4de6edc25d693b13ca71f673b961c21476764e7393
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00015-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7bfc7224b4a4fba90768539b6288566af24d0ca090b2dc0156dc0ad28d1e1e54
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00016-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bdcae6cc2f677c801fa779a1b72824d88b43eb0675bcefd593bc383df5fb3d1d
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00017-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4deacfdd0e4e2847557de3edd5bc23671650e4d485bc69512e537afeff2f32de
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00018-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:91176b135c1b39df8a5a6dd9a2a670a0940e094397c6b0c01373049f03059801
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00019-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a30e0ac0adfe9cfe09252ebb3d47905e81563f23475a3e1b2a97891ed59347d
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00020-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:90203e0063ac2e55146be952fef72c46157a0003acaa79b5cadfbf153dd5610e
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00021-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0de55a070ad26138e56e1b2751f9ffed85d3517205711ac90a12ca1c71be3b18
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00022-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dd06e743c8f9fcb0994b138ac2ca1e2d329fe2ba657f93bfee9c9068941e638b
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00023-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:48ad29c027ad4bac585f893b27bb28871ed71942bc072696cec386a309534fa9
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00024-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2df7120f7f10e6fefe19bd6b8408ba545494b6f7002eba8c0061b513ee98c23c
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00025-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee95d938025869a4370b18c010cb4086531d1d2016238f42f0294dd9eb514979
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00026-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf2575afdb3fd1ccf1ebccd034d0edbddaa96f2e98447d7152011b28b2a1d5e3
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00027-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:64cd13368f1917e2cb5d112a40e335029e272aeba359f3d4226245aec578d0aa
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00028-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c0b9a43bb71229ba2ca79a82c5517a23fe00387c0567382473942608f66778ee
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00029-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ebd0f387ea4fe1786b044a1157caf3ac0ff06f79b8db2ded0427883b9f92537
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00030-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:779609dee1912e1d221703664ad475f60b65f5ac61e7039806fd83d07a4edc90
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00031-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9331130671cc488fe886aba3920d9d5dbf894265d8ea2659d1e38dcb23e78aaa
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00032-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b05fa04617fd6b85a58287b91b45c31e26026f6d63e8c3a2ff45dc4a86c61f60
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00033-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:42a0ee9eb9314c7f396b0888f10695bd006039f8460cf1ca00953775dd975b58
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00034-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d34619a41bbade9280cde541feaf08da1ebf6a652dd539c43ca4ba524253f595
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00035-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a872922e55ca3b1019999cbcfcb566df172b9b4e8d5502e39b107b63f3fed28f
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00036-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c24a8791d61c5c3768b09449571f498a2002425c53e9133f1843e3a2eb8f071c
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00037-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5bab60ac972190ab568261ca86262c8d0f37ba2a6a5ed0eb8a5caf1114b62a2
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00038-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cce9d7d66c9173d5c62dca5a6ecf562ca73156f12035a5e34f69ca7e979e82d1
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00039-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a7e1c01f52b9471d6156e7b2f2aa503c2712c067b805e83acea7a34e9c61b06b
+size 9948949760

Q2_K-GGUF/Q2_K-GGUF-00040-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:11b0f28e4676c3d1c8982f9478fa02c191d0c0e26c1b20a0f1975d0f4f9e8757
+size 8617252768

Q2_K-GGUF/Q2_K-GGUF-00041-of-00041.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70aee54af148b62a45f50c002362a18224cf816868eb92f094687bb5348b0b22
+size 3720049152

Q3_K-GGUF/Q3_K-GGUF-00001-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a65b9d921e69c01eb388f56e3472d7814e7f3391011fc88b65c7c649543d3ef6
+size 8108227360

Q3_K-GGUF/Q3_K-GGUF-00002-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9c23cde2247c43502940698d52226d75394d07068353dbc3751635fbe0e60da2
+size 8805551360

Q3_K-GGUF/Q3_K-GGUF-00003-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:46559c3bc1b26438beb39f487ea83c3c43cb1c993265b3bc3455ea3815074e5c
+size 8099073280

Q3_K-GGUF/Q3_K-GGUF-00004-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:56a425c49874ca86750d4de936d0b5853595b6dfc908494ae33050c1568400b8
+size 8099073280

Q3_K-GGUF/Q3_K-GGUF-00005-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:14e8eb5ece7a5fda6d60f9146a65275291cfba542e1b36a2c0292a46fdad9b67
+size 8099073280

Q3_K-GGUF/Q3_K-GGUF-00006-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bb83db38163351e8a9003a317010bafc06816424a6cd1fcc7005db33509db596
+size 8099073280

Q3_K-GGUF/Q3_K-GGUF-00007-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:31d512168fbc2547fd738f81fb847b8bd8d4ba5b055dbaebbde1ff276171fbb6
+size 8099073280

Q3_K-GGUF/Q3_K-GGUF-00008-of-00061.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6889700cdef4d9d40a32434e28fdcea51aa9be2fd75c9399bd63f8a3f0eef405
+size 8099073280