Instructions to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Use Docker
docker model run hf.co/Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Ollama:
ollama run hf.co/Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
- Unsloth Studio
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF to start chatting
- Pi
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Docker Model Runner:
docker model run hf.co/Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
- Lemonade
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Qwen-Image-Edit-Rapid-AIO-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Phil2Sat/Qwen-Image-Edit-Rapid-AIO-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Where did the models go?
Okay umm. Where did the models go?
actually uploading a refresh so in first step v5.2, after that an optimized quant of v5.
wanted to cleanup folder structure so deleted everything
i guess i skip 5.1 completely
takes a while to upload 220gb with 50mbit
thanks love your stuff hope you do a flux AIO one day
I think skiping v5.1 is ok. Thank you for keeping this repo up to date :)
We're eagerly awaiting it! Thank you!
97/226GB at ~7mb/s, hate the slow upload and next the updated v5, another ~226gb.
dang just saw v5.3 released, that will be a long upload session today:
for what i saw:
added https://civitai.com/models/2058077/qwen-imagensfwadv1
and reeanabled cockqwen some minor weights change like from 0.8 to 0.75 for mncl, meta4 and qwen4play loras
dang just saw v5.3 released, that will be a long upload session today:
for what i saw:
added https://civitai.com/models/2058077/qwen-imagensfwadv1
and reeanabled cockqwen some minor weights change like from 0.8 to 0.75 for mncl, meta4 and qwen4play loras
Yeap 5.3 released. I think we'll see more high-quality models.
btw developed a new quant method, sorting exactly which blocks needed to stay in high precision, landed somewhere between my first Q8_0 attempt and the hq version i took offline which had some blocks in fp32.
since im testing with the worst possible quant q2_k i have to say i see no real difference in the original model compared to the q2_k.
neat thing future uploads are a little bit smaller with a little bit better quality and prompt adherance. at least my yesterday tests showed me.
left 4-step q2_k v5.2, right input, added https://civitai.com/models/1939453/qwenedit-consistence-lora with 0.48 additionally in my comfyui workflow on top of the AIO.
this is a cutout of a from thighs, 720x1456 image without any post process, i think for the nah i wouldnt use any q2_k it does well.
v52 up
v50 uploading
v53 gguffing
v52 up
v50 uploading
v53 gguffing
YAY FINNALLYY! Is there much difference between 5.2 and 5.3? I'm downloading 5.2 right now.
couldnt even test 5.3 as my machine is working... i guess until tomorrow
BTW 5.2 Q5_K_M Not working as well. The model isn't doing any of what I wrote. I think there's a problem.
NVM, It's working this is my fault lol.
all up..
v7.1 up, initial tests, bad at multi image and consistency, much worse than v5.3
Agree, too focused on NSFW content. Bad anatomy on heads (too big), not natural looking. Will try some more and maybe report back.
Noticed now: "V7: valiantcat/Qwen-Image-Edit-MeiTu and chestnutlzj/Edit-R1-Qwen-Image-Edit-2509 included as LORAs.".
That MeiTu version does not work good. Tried it earlier also.
v7.1 up, initial tests, bad at multi image and consistency, much worse than v5.3
I think it gets worse as more lora is added. For now, v5 is the best for me.