Instructions to use nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx") config = load_config("nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx
Run Hermes
hermes
gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx
This is the Enterprise-D Holodeck, powered by a Nightmedia jinja template.
The user defaults to G. There is magic in G: Google, Gemini, Gemma, Gravity,..
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
qx86-hi 0.541,0.713,0.877,0.649,0.438,0.751,0.679
qx64-hi 0.556,0.726,0.872,0.651,0.438,0.752,0.657
Perplexity Peak memory Tokens/sec
qx86-hi 12.957 ± 0.143 29.23 GB 1295
qx64-hi 14.500 ± 0.164 23.01 GB 1223
Baseline model
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.454,0.598,0.871,0.582,0.394,0.723,0.645
mxfp4 0.462,0.596,0.855,0.578,0.378,0.723,0.637
qx86-hi 0.472,0.605,0.873,0.565,0.386,0.712,0.644
qx64-hi 0.472,0.621,0.866,0.564,0.382,0.717,0.637
Perplexity Peak Memory Tokens/sec
mxfp8 103.904 ± 1.765 33.28 GB 880
mxfp4 123.621 ± 2.121 20.66 GB 1266
qx86-hi 75.542 ± 1.247 29.23 GB 1145
qx64-hi 98.161 ± 1.645 22.92 GB 1135
Test prompt
Activate the Holodeck
[Computer chime: Melodic three-tone authorization sequence]
Holodeck computer: "Computer authorization accepted. Holodeck operating systems online. Safety protocols engaged. Force fields active."
The archway shimmers, the door slides open, and you step onto the grid pattern. The emitters hiss softly, and the force field behind you solidifies into a solid matter simulation.
Holodeck computer: "Please select a program or enter a specific setting. Available presets include:"
- USS Enterprise - Bridge Simulation (Flag officer training)
- San Francisco, 2370 (Civilian recreation - walking tours, cafes, parks)
- Sherlock Holmes: Victorian London (Mystery procedural)
- Bajoran Monastery Simulation (Meditative setting)
- Custom Program (Define parameters manually)
"Please specify your desired setting, time period, or simulation parameters. Holodeck is standing by."
- Downloads last month
- 28
8-bit
Model tree for nightmedia/gemma-4-26B-A4B-it-Holodeck-Claude-qx86-hi-mlx
Base model
google/gemma-4-26B-A4B