Instructions to use mlx-community/LFM2.5-1.2B-Thinking-5bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/LFM2.5-1.2B-Thinking-5bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/LFM2.5-1.2B-Thinking-5bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use mlx-community/LFM2.5-1.2B-Thinking-5bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/LFM2.5-1.2B-Thinking-5bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mlx-community/LFM2.5-1.2B-Thinking-5bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use mlx-community/LFM2.5-1.2B-Thinking-5bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/LFM2.5-1.2B-Thinking-5bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mlx-community/LFM2.5-1.2B-Thinking-5bit
Run Hermes
hermes
- MLX LM
How to use mlx-community/LFM2.5-1.2B-Thinking-5bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "mlx-community/LFM2.5-1.2B-Thinking-5bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "mlx-community/LFM2.5-1.2B-Thinking-5bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mlx-community/LFM2.5-1.2B-Thinking-5bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
| { | |
| "metadata": { | |
| "total_size": 804779520, | |
| "total_parameters": 1170340608 | |
| }, | |
| "weight_map": { | |
| "model.embed_tokens.biases": "model.safetensors", | |
| "model.embed_tokens.scales": "model.safetensors", | |
| "model.embed_tokens.weight": "model.safetensors", | |
| "model.embedding_norm.weight": "model.safetensors", | |
| "model.layers.0.conv.conv.weight": "model.safetensors", | |
| "model.layers.0.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.0.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.0.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.0.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.0.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.0.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.0.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.0.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.0.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.0.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.0.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.0.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.0.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.0.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.0.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.0.ffn_norm.weight": "model.safetensors", | |
| "model.layers.0.operator_norm.weight": "model.safetensors", | |
| "model.layers.1.conv.conv.weight": "model.safetensors", | |
| "model.layers.1.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.1.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.1.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.1.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.1.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.1.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.1.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.1.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.1.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.1.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.1.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.1.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.1.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.1.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.1.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.1.ffn_norm.weight": "model.safetensors", | |
| "model.layers.1.operator_norm.weight": "model.safetensors", | |
| "model.layers.10.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.10.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.10.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.10.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.10.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.10.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.10.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.10.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.10.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.10.ffn_norm.weight": "model.safetensors", | |
| "model.layers.10.operator_norm.weight": "model.safetensors", | |
| "model.layers.10.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.10.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.10.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.10.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.10.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.10.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.10.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.10.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.10.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.10.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.10.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.10.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.10.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.10.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.11.conv.conv.weight": "model.safetensors", | |
| "model.layers.11.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.11.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.11.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.11.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.11.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.11.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.11.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.11.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.11.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.11.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.11.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.11.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.11.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.11.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.11.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.11.ffn_norm.weight": "model.safetensors", | |
| "model.layers.11.operator_norm.weight": "model.safetensors", | |
| "model.layers.12.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.12.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.12.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.12.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.12.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.12.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.12.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.12.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.12.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.12.ffn_norm.weight": "model.safetensors", | |
| "model.layers.12.operator_norm.weight": "model.safetensors", | |
| "model.layers.12.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.12.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.12.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.12.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.12.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.12.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.12.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.12.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.12.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.12.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.12.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.12.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.12.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.12.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.13.conv.conv.weight": "model.safetensors", | |
| "model.layers.13.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.13.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.13.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.13.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.13.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.13.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.13.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.13.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.13.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.13.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.13.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.13.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.13.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.13.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.13.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.13.ffn_norm.weight": "model.safetensors", | |
| "model.layers.13.operator_norm.weight": "model.safetensors", | |
| "model.layers.14.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.14.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.14.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.14.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.14.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.14.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.14.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.14.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.14.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.14.ffn_norm.weight": "model.safetensors", | |
| "model.layers.14.operator_norm.weight": "model.safetensors", | |
| "model.layers.14.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.14.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.14.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.14.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.14.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.14.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.14.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.14.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.14.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.14.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.14.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.14.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.14.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.14.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.15.conv.conv.weight": "model.safetensors", | |
| "model.layers.15.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.15.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.15.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.15.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.15.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.15.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.15.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.15.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.15.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.15.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.15.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.15.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.15.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.15.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.15.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.15.ffn_norm.weight": "model.safetensors", | |
| "model.layers.15.operator_norm.weight": "model.safetensors", | |
| "model.layers.2.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.2.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.2.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.2.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.2.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.2.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.2.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.2.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.2.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.2.ffn_norm.weight": "model.safetensors", | |
| "model.layers.2.operator_norm.weight": "model.safetensors", | |
| "model.layers.2.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.2.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.2.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.2.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.2.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.2.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.2.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.2.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.2.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.2.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.2.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.2.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.2.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.2.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.3.conv.conv.weight": "model.safetensors", | |
| "model.layers.3.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.3.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.3.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.3.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.3.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.3.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.3.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.3.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.3.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.3.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.3.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.3.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.3.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.3.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.3.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.3.ffn_norm.weight": "model.safetensors", | |
| "model.layers.3.operator_norm.weight": "model.safetensors", | |
| "model.layers.4.conv.conv.weight": "model.safetensors", | |
| "model.layers.4.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.4.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.4.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.4.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.4.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.4.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.4.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.4.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.4.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.4.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.4.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.4.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.4.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.4.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.4.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.4.ffn_norm.weight": "model.safetensors", | |
| "model.layers.4.operator_norm.weight": "model.safetensors", | |
| "model.layers.5.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.5.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.5.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.5.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.5.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.5.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.5.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.5.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.5.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.5.ffn_norm.weight": "model.safetensors", | |
| "model.layers.5.operator_norm.weight": "model.safetensors", | |
| "model.layers.5.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.5.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.5.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.5.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.5.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.5.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.5.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.5.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.5.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.5.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.5.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.5.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.5.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.5.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.6.conv.conv.weight": "model.safetensors", | |
| "model.layers.6.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.6.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.6.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.6.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.6.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.6.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.6.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.6.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.6.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.6.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.6.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.6.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.6.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.6.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.6.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.6.ffn_norm.weight": "model.safetensors", | |
| "model.layers.6.operator_norm.weight": "model.safetensors", | |
| "model.layers.7.conv.conv.weight": "model.safetensors", | |
| "model.layers.7.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.7.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.7.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.7.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.7.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.7.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.7.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.7.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.7.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.7.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.7.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.7.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.7.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.7.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.7.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.7.ffn_norm.weight": "model.safetensors", | |
| "model.layers.7.operator_norm.weight": "model.safetensors", | |
| "model.layers.8.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.8.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.8.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.8.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.8.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.8.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.8.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.8.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.8.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.8.ffn_norm.weight": "model.safetensors", | |
| "model.layers.8.operator_norm.weight": "model.safetensors", | |
| "model.layers.8.self_attn.k_layernorm.weight": "model.safetensors", | |
| "model.layers.8.self_attn.k_proj.biases": "model.safetensors", | |
| "model.layers.8.self_attn.k_proj.scales": "model.safetensors", | |
| "model.layers.8.self_attn.k_proj.weight": "model.safetensors", | |
| "model.layers.8.self_attn.out_proj.biases": "model.safetensors", | |
| "model.layers.8.self_attn.out_proj.scales": "model.safetensors", | |
| "model.layers.8.self_attn.out_proj.weight": "model.safetensors", | |
| "model.layers.8.self_attn.q_layernorm.weight": "model.safetensors", | |
| "model.layers.8.self_attn.q_proj.biases": "model.safetensors", | |
| "model.layers.8.self_attn.q_proj.scales": "model.safetensors", | |
| "model.layers.8.self_attn.q_proj.weight": "model.safetensors", | |
| "model.layers.8.self_attn.v_proj.biases": "model.safetensors", | |
| "model.layers.8.self_attn.v_proj.scales": "model.safetensors", | |
| "model.layers.8.self_attn.v_proj.weight": "model.safetensors", | |
| "model.layers.9.conv.conv.weight": "model.safetensors", | |
| "model.layers.9.conv.in_proj.biases": "model.safetensors", | |
| "model.layers.9.conv.in_proj.scales": "model.safetensors", | |
| "model.layers.9.conv.in_proj.weight": "model.safetensors", | |
| "model.layers.9.conv.out_proj.biases": "model.safetensors", | |
| "model.layers.9.conv.out_proj.scales": "model.safetensors", | |
| "model.layers.9.conv.out_proj.weight": "model.safetensors", | |
| "model.layers.9.feed_forward.w1.biases": "model.safetensors", | |
| "model.layers.9.feed_forward.w1.scales": "model.safetensors", | |
| "model.layers.9.feed_forward.w1.weight": "model.safetensors", | |
| "model.layers.9.feed_forward.w2.biases": "model.safetensors", | |
| "model.layers.9.feed_forward.w2.scales": "model.safetensors", | |
| "model.layers.9.feed_forward.w2.weight": "model.safetensors", | |
| "model.layers.9.feed_forward.w3.biases": "model.safetensors", | |
| "model.layers.9.feed_forward.w3.scales": "model.safetensors", | |
| "model.layers.9.feed_forward.w3.weight": "model.safetensors", | |
| "model.layers.9.ffn_norm.weight": "model.safetensors", | |
| "model.layers.9.operator_norm.weight": "model.safetensors" | |
| } | |
| } |