Text Generation
GGUF
English
Chinese
qwen3_5
qwen3.8
quantized
imatrix
iq3_s
iq4_xs
q3_k
q5_k
ssm-fix
conv1d-repair
llama.cpp
conversational
Instructions to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: llama cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: llama cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: ./llama-cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Use Docker
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- LM Studio
- Jan
- vLLM
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Ollama
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Ollama:
ollama run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Unsloth Studio
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF to start chatting
- Pi
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Docker Model Runner:
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Lemonade
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Run and chat with the model
lemonade run user.Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF-UD-Q3_K_XL
List all available models
lemonade list
- Hermes Agent
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| Apache License | |
| Version 2.0, January 2004 | |
| http://www.apache.org/licenses/ | |
| TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION | |
| 1. Definitions. | |
| "License" shall mean the terms and conditions for use, reproduction, | |
| and distribution as defined by Sections 1 through 9 of this document. | |
| "Licensor" shall mean the copyright owner or entity authorized by | |
| the copyright owner that is granting the License. | |
| "Legal Entity" shall mean the union of the acting entity and all | |
| other entities that control, are controlled by, or are under common | |
| control with that entity. For the purposes of this definition, | |
| "control" means (i) the power, direct or indirect, to cause the | |
| direction or management of such entity, whether by contract or | |
| otherwise, or (ii) ownership of fifty percent (50%) or more of the | |
| outstanding shares, or (iii) beneficial ownership. | |
| "You" (or "Your") shall mean an individual or Legal Entity | |
| exercising permissions granted by this License. | |
| "Source" form shall mean the preferred form for making modifications, | |
| including but not limited to software source code, documentation | |
| source, and configuration files. | |
| "Object" form shall mean any form resulting from mechanical | |
| transformation or translation of a Source form, including but | |
| not limited to compiled object code, generated documentation, | |
| and conversions to other media types. | |
| "Work" shall mean the work of authorship, whether in Source or | |
| Object form, made available under the License, as indicated by a | |
| copyright notice that is included in or attached to the work. | |
| "Derivative Works" shall mean any work of authorship, whether in | |
| Source or Object form, that is based on (or derived from) the Work | |
| and for which the editorial revisions, annotations, elaborations, | |
| or other modifications represent, as a whole, an original work of | |
| authorship. Derivative Works shall not include works that remain | |
| separable from, or merely link (or bind by name) to the interfaces | |
| of, the Work and Derivative Works thereof. | |
| "Contribution" shall mean any work of authorship, including | |
| the original version of the Work and any modifications or additions | |
| to that Work or Derivative Works thereof, that is intentionally | |
| submitted to Licensor for inclusion in the Work by the copyright | |
| owner or by an individual or Legal Entity authorized to submit on | |
| behalf of the copyright owner. | |
| "Contributor" shall mean Licensor and any individual or Legal Entity | |
| on behalf of whom a Contribution has been received by Licensor and | |
| subsequently incorporated within the Work. | |
| 2. Grant of Copyright License. Subject to the terms and conditions of | |
| this License, each Contributor hereby grants to You a perpetual, | |
| worldwide, non-exclusive, no-charge, royalty-free, irrevocable | |
| copyright license to reproduce, prepare Derivative Works of, | |
| publicly display, publicly perform, sublicense, and distribute the | |
| Work and such Derivative Works in Source or Object form. | |
| 3. Grant of Patent License. Subject to the terms and conditions of | |
| this License, each Contributor hereby grants to You a perpetual, | |
| worldwide, non-exclusive, no-charge, royalty-free, irrevocable | |
| (except as stated in this section) patent license to make, have made, | |
| use, offer to sell, sell, import, and otherwise transfer the Work, | |
| where such license applies only to those patent claims licensable | |
| by such Contributor that are necessarily infringed by their | |
| Contribution(s) alone or by combination of their Contribution(s) | |
| with the Work to which such Contribution(s) was submitted. | |
| 4. Redistribution. You may reproduce and distribute copies of the | |
| Work or Derivative Works thereof in any medium, with or without | |
| modifications, and in Source or Object form, provided that You meet | |
| the following conditions: | |
| (a) You must give any other recipients of the Work or Derivative | |
| Works a copy of this License; and | |
| (b) You must cause any modified files to carry prominent notices | |
| stating that You changed the files; and | |
| (c) You must retain, in the Source form of any Derivative Works that | |
| You distribute, all copyright, patent, trademark, and attribution | |
| notices from the Source form of the Work, excluding those notices | |
| that do not pertain to any part of the Derivative Works; and | |
| (d) If the Work includes a NOTICE text file as part of its | |
| distribution, then any Derivative Works that You distribute must | |
| include a readable copy of the attribution notices contained | |
| within such NOTICE file, excluding those notices that do not | |
| pertain to any part of the Derivative Works. | |
| 5. Submission of Contributions. Unless You explicitly state otherwise, | |
| any Contribution intentionally submitted for inclusion in the Work | |
| by You to the Licensor shall be under the terms and conditions of | |
| this License, without any additional terms or conditions. | |
| 6. Trademarks. This License does not grant permission to use the trade | |
| names, trademarks, service marks, or product names of the Licensor, | |
| except as required for reasonable and customary use in describing | |
| the origin of the Work. | |
| 7. Disclaimer of Warranty. Unless required by applicable law or agreed | |
| to in writing, Licensor provides the Work on an "AS IS" BASIS, | |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or | |
| implied, including, without limitation, any warranties or conditions | |
| of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A | |
| PARTICULAR PURPOSE. | |
| 8. Limitation of Liability. In no event and under no legal theory, | |
| whether in tort, contract, or otherwise, unless required by applicable | |
| law, shall any Contributor be liable to You for damages arising from | |
| the use of or inability to use the Work. | |
| 9. Accepting Warranty or Additional Liability. While redistributing | |
| the Work or Derivative Works thereof, You may choose to offer, and | |
| charge a fee for, acceptance of support, warranty, indemnity, or | |
| other liability obligations and/or rights consistent with this | |
| License. However, in accepting such obligations, You may act only on | |
| Your own behalf and on Your sole responsibility. | |
| END OF TERMS AND CONDITIONS | |
| APPENDIX: How to apply the Apache License to your work. | |
| Copyright 2026 Alibaba Cloud | |
| Licensed under the Apache License, Version 2.0 (the "License"); | |
| you may not use this file except in compliance with the License. | |
| You may obtain a copy of the License at | |
| http://www.apache.org/licenses/LICENSE-2.0 | |
| Unless required by applicable law or agreed to in writing, software | |
| distributed under the License is distributed on an "AS IS" BASIS, | |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| See the License for the specific language governing permissions and | |
| limitations under the License. | |