Instructions to use ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX") config = load_config("ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ilyakam/Geer-Ornith-1.0-35B-A3B-4-8bit-MLX" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| { | |
| "activation": "manual", | |
| "bytes": 21643961289, | |
| "conversion": { | |
| "dtype": "bfloat16", | |
| "packages": { | |
| "hf-xet": "1.5.2", | |
| "huggingface-hub": "1.24.0", | |
| "mlx": "0.32.0", | |
| "mlx-lm": "0.31.3", | |
| "mlx-vlm": "0.6.3", | |
| "safetensors": "0.8.0" | |
| }, | |
| "transform": "qwen3_5_moe_unfused_experts" | |
| }, | |
| "display_name": "Geer Ornith 1.0 35B-A3B (4/8-bit MLX)", | |
| "files": [ | |
| { | |
| "bytes": 1097, | |
| "path": "LICENSE", | |
| "sha256": "c85a2fc5f18587d672f034c9f3d9c5815c70bda75ff6cb4cbe14973b3523d669" | |
| }, | |
| { | |
| "bytes": 10732, | |
| "path": "LICENSE-QWEN", | |
| "sha256": "1a0b44ec2d17abe09bf71e237c85d64f8a3763c4345f14044359f0ae1a379898" | |
| }, | |
| { | |
| "bytes": 906, | |
| "path": "NOTICE", | |
| "sha256": "2d9d3af2d10985d93887c3dbb71a2469b3bc566fdb0ddeb66176773ff3f1ebe9" | |
| }, | |
| { | |
| "bytes": 2952, | |
| "path": "README.md", | |
| "sha256": "02ae8b8cd963beda263240a03b07cc75cac4c61b92e3c6b87e261ccb9e2782ec" | |
| }, | |
| { | |
| "bytes": 595298, | |
| "path": "assets/ornith_35b_eval.png", | |
| "sha256": "03a8648a556a133104b78d54ef090a2facb08cf36e207ceb4b919ecd2389f68b" | |
| }, | |
| { | |
| "bytes": 962441, | |
| "path": "assets/ornith_logo.png", | |
| "sha256": "458ee0d85baea4d1fc0b099245f243b21006f696921f896a5b59980a6eadef6a" | |
| }, | |
| { | |
| "bytes": 7536, | |
| "path": "chat_template.jinja", | |
| "sha256": "182e77dd83bd8e9ca818b240b82e28f243762cd5dda32e6eef327df7b1cd107e" | |
| }, | |
| { | |
| "bytes": 167513, | |
| "path": "config.json", | |
| "sha256": "3383f2c9e4099cf35e0988a3f7215c8758ccf18968b640c83963b66d07bb6d55" | |
| }, | |
| { | |
| "bytes": 798, | |
| "path": "geer-recipe.toml", | |
| "sha256": "dced89ef3a293d3422eba17bc092f18d18c4d14af96ed8b3093651beb141e281" | |
| }, | |
| { | |
| "bytes": 5311, | |
| "path": "geer-source-manifest.json", | |
| "sha256": "73d20c859cf5ccd05c79411e96ffe2d626f119d2a9bc6f9969e55ddd3b655a73" | |
| }, | |
| { | |
| "bytes": 213, | |
| "path": "generation_config.json", | |
| "sha256": "896eeba60a1195e034dc6b9a7bbddd64b6174992348f5dc7d75daaa93d0bdd45" | |
| }, | |
| { | |
| "bytes": 5361870686, | |
| "path": "model-00001-of-00005.safetensors", | |
| "sha256": "ee30227615fbc430eacdfd17fc0fa531ec2c7f6dc5acf147786574cc54c430b5" | |
| }, | |
| { | |
| "bytes": 5252145555, | |
| "path": "model-00002-of-00005.safetensors", | |
| "sha256": "93203769a82d17ee6d2941e827b392059ca037387592db7bcf1fbcbf9ac9dc59" | |
| }, | |
| { | |
| "bytes": 5248667922, | |
| "path": "model-00003-of-00005.safetensors", | |
| "sha256": "2b3be3c574fe92b63bc20b98f4f07697256d2c9779b5b821f0aa0f297e55d514" | |
| }, | |
| { | |
| "bytes": 5212246892, | |
| "path": "model-00004-of-00005.safetensors", | |
| "sha256": "61adc37eee4e85ade1d0c5d2d82f9e2d550b81b78979e6a8e53161b5327a0670" | |
| }, | |
| { | |
| "bytes": 540344667, | |
| "path": "model-00005-of-00005.safetensors", | |
| "sha256": "259f82efaf13be9af40eb427d913a51c8bb340e57bfd8ea2b5cf629a5cb78de6" | |
| }, | |
| { | |
| "bytes": 215755, | |
| "path": "model.safetensors.index.json", | |
| "sha256": "a7115df2295b18adbcf9c66dde60fb75970725adbd08bf1ad69184503a158049" | |
| }, | |
| { | |
| "bytes": 390, | |
| "path": "preprocessor_config.json", | |
| "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516" | |
| }, | |
| { | |
| "bytes": 991, | |
| "path": "processor_config.json", | |
| "sha256": "45fc17c8dd2474af6b493b52483c26c0584b0082d368c480f9fa611e73070040" | |
| }, | |
| { | |
| "bytes": 19989325, | |
| "path": "tokenizer.json", | |
| "sha256": "06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523" | |
| }, | |
| { | |
| "bytes": 1165, | |
| "path": "tokenizer_config.json", | |
| "sha256": "792fa3f0cb88b111e54ef3134c873531008c4df471d108da17903426e308aa7b" | |
| }, | |
| { | |
| "bytes": 385, | |
| "path": "video_preprocessor_config.json", | |
| "sha256": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13" | |
| }, | |
| { | |
| "bytes": 6722759, | |
| "path": "vocab.json", | |
| "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003" | |
| } | |
| ], | |
| "quantization": { | |
| "bits": 4, | |
| "enabled": true, | |
| "group_size": 64, | |
| "high_bits": 8, | |
| "mode": "affine", | |
| "strategy": "routed_experts_4bit_protected_text_8bit" | |
| }, | |
| "recipe": "ornith-1.0-35b-4-8bit", | |
| "schema_version": 1, | |
| "source": { | |
| "license": "MIT", | |
| "license_evidence_url": "https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B/blob/5df2ed3f675c7beaa490328cc70bb573b65fb660/README.md", | |
| "manifest_sha256": "73d20c859cf5ccd05c79411e96ffe2d626f119d2a9bc6f9969e55ddd3b655a73", | |
| "repo_id": "deepreinforce-ai/Ornith-1.0-35B", | |
| "revision": "5df2ed3f675c7beaa490328cc70bb573b65fb660" | |
| } | |
| } | |