How to use from
Hermes AgentConfigure Hermes
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default LetheanNetwork/lemma-mlx-bf16Run Hermes
hermesQuick Links
LetheanNetwork/lemma-mlx-bf16
Gemma 4 in MLX format, full bf16 precision, converted from
LetheanNetwork/lemma's bf16
safetensors via mlx_lm.convert --dtype bfloat16 (no quantization).
The full-precision reference for the MLX family. For the LEK-merged
variant see lthn/lemma.
License
Apache 2.0, subject to the Gemma Terms of Use.
- Downloads last month
- 2
Model size
8B params
Tensor type
BF16
·
Hardware compatibility
Log In to add your hardware
Quantized
Start the MLX server
# Install MLX LM: uv tool install mlx-lm# Start a local OpenAI-compatible server: mlx_lm.server --model "LetheanNetwork/lemma-mlx-bf16"