Instructions to use bartek-flp/gemma4-12b-dcr-v7-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf bartek-flp/gemma4-12b-dcr-v7-GGUF # Run inference directly in the terminal: llama cli -hf bartek-flp/gemma4-12b-dcr-v7-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf bartek-flp/gemma4-12b-dcr-v7-GGUF # Run inference directly in the terminal: llama cli -hf bartek-flp/gemma4-12b-dcr-v7-GGUF
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf bartek-flp/gemma4-12b-dcr-v7-GGUF # Run inference directly in the terminal: ./llama-cli -hf bartek-flp/gemma4-12b-dcr-v7-GGUF
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf bartek-flp/gemma4-12b-dcr-v7-GGUF # Run inference directly in the terminal: ./build/bin/llama-cli -hf bartek-flp/gemma4-12b-dcr-v7-GGUF
Use Docker
docker model run hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
- LM Studio
- Jan
- vLLM
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bartek-flp/gemma4-12b-dcr-v7-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bartek-flp/gemma4-12b-dcr-v7-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
- Ollama
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with Ollama:
ollama run hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
- Unsloth Studio
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for bartek-flp/gemma4-12b-dcr-v7-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for bartek-flp/gemma4-12b-dcr-v7-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for bartek-flp/gemma4-12b-dcr-v7-GGUF to start chatting
- Docker Model Runner
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with Docker Model Runner:
docker model run hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
- Lemonade
How to use bartek-flp/gemma4-12b-dcr-v7-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull bartek-flp/gemma4-12b-dcr-v7-GGUF
Run and chat with the model
lemonade run user.gemma4-12b-dcr-v7-GGUF-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
gemma4-12b-dcr-v7 β a senior-grade Drupal reviewer that knows how sure it is
A 12B Gemma-4 model fine-tuned to review Drupal 10/11 pull requests the way a senior maintainer would β and, new in v7, to attach a calibrated confidence and a citation to every finding.
Runs locally. The q8 GGUF here is ~12.7 GB and works on a 16 GB Mac via Ollama. 0% data leaves your machine.
What it does
Give it a PHP/Drupal diff; it returns JSON only:
{
"verdict": "issues_found",
"findings": [
{
"severity": "high", "category": "drupal_api",
"file": "src/Service/Importer.php", "line": 42,
"message": "Entities are loaded one-by-one inside the loop (N+1). Use loadMultiple().",
"suggestion": "$nodes = $storage->loadMultiple($ids);",
"confidence": 0.85,
"citation": "https://api.drupal.org/.../EntityStorageInterface::loadMultiple"
}
]
}
It catches the Drupal-specific things a generic code model misses: missing #cache metadata, \Drupal:: static calls that should be injected, deprecated APIs, render/XSS, access/CSRF gaps, entity-load-in-loops, and security regressions (it even recognises specific SA-CORE advisories).
What's new in v7 β calibrated confidence
Earlier versions emitted a flat confidence (every finding β 0.7), which made the score useless for gating. v7 emits genuinely varied, calibrated confidence β higher for citable, clear-cut defects, lower for plausible-but-unverified ones. That lets you auto-keep the high-confidence findings and route the rest to a human, turning the model from a noisy second opinion into a trustworthy second reviewer.
Benchmarks
On a held-out set of real Drupal merge-request pairs (pre-fix code with a real defect vs the clean post-fix code), single-call:
| metric | v7 |
|---|---|
| recall (real defects caught) | 0.70 |
| specificity (no false alarm on clean code) | 0.95 |
| per-finding confidence | varied 0.68β0.85 (was flat ~0.7) |
On real merge requests it flags things like SA-CORE information-disclosure regressions (with the advisory cited), N+1 entity loads, dependency-injection anti-patterns and deprecated-API usage β each with a confidence and a source.
What worked
A senior Drupal reviewer's judgement β grounded in real api.drupal.org docs, coding standards, change-records and security advisories β was distilled into the model, supervising not just what to flag but how confident to be and which rule to cite. v7 is a focused continuation of our prior Drupal reviewer, so it keeps that model's breadth and gains the confidence calibration.
Run it
ollama pull hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
ollama run hf.co/bartek-flp/gemma4-12b-dcr-v7-GGUF
The matching LoRA adapter (for vLLM serving or further training) is at bartek-flp/gemma4-12b-dcr-v7-lora.
Notes
- Best used as a CI / second-reviewer assistant, not an autonomous gate β it surfaces issues for a human and now tells you which ones it's sure about.
- Base model:
unsloth/gemma-4-12B-it(Gemma terms apply).
- Downloads last month
- 10
We're not able to determine the quantization variants.