Instructions to use mlx-community/LFM2.5-2.6B-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/LFM2.5-2.6B-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/LFM2.5-2.6B-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use mlx-community/LFM2.5-2.6B-8bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/LFM2.5-2.6B-8bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mlx-community/LFM2.5-2.6B-8bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use mlx-community/LFM2.5-2.6B-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "mlx-community/LFM2.5-2.6B-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "mlx-community/LFM2.5-2.6B-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mlx-community/LFM2.5-2.6B-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use mlx-community/LFM2.5-2.6B-8bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/LFM2.5-2.6B-8bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mlx-community/LFM2.5-2.6B-8bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use mlx-community/LFM2.5-2.6B-8bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/LFM2.5-2.6B-8bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "mlx-community/LFM2.5-2.6B-8bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| { | |
| "metadata": { | |
| "total_size": 2866018304 | |
| }, | |
| "weight_map": { | |
| "language_model.model.embed_tokens.biases": "model.safetensors", | |
| "language_model.model.embed_tokens.scales": "model.safetensors", | |
| "language_model.model.embed_tokens.weight": "model.safetensors", | |
| "language_model.model.embedding_norm.weight": "model.safetensors", | |
| "language_model.model.layers.0.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.0.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.0.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.0.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.0.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.0.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.0.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.0.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.0.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.0.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.1.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.1.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.1.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.1.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.1.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.1.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.1.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.1.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.1.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.1.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.10.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.10.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.10.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.10.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.10.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.10.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.10.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.10.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.10.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.10.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.11.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.11.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.11.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.11.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.11.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.11.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.11.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.11.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.11.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.11.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.12.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.12.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.12.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.12.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.12.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.12.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.12.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.12.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.12.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.12.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.13.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.13.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.13.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.13.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.14.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.14.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.14.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.14.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.14.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.14.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.14.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.14.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.14.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.14.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.15.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.15.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.15.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.15.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.15.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.15.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.15.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.15.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.15.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.15.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.16.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.16.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.16.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.16.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.16.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.16.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.16.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.16.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.16.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.16.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.17.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.17.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.17.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.17.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.18.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.18.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.18.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.18.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.18.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.18.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.18.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.18.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.18.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.18.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.19.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.19.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.19.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.19.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.19.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.19.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.19.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.19.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.19.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.19.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.2.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.2.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.2.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.2.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.20.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.20.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.20.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.20.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.20.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.20.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.20.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.20.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.20.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.20.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.21.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.21.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.21.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.21.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.22.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.22.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.22.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.22.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.22.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.22.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.22.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.22.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.22.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.22.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.23.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.23.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.23.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.23.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.23.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.23.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.23.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.23.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.23.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.23.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.24.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.24.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.24.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.24.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.25.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.25.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.25.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.25.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.25.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.25.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.25.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.25.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.25.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.25.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.26.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.26.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.26.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.26.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.26.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.26.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.26.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.26.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.26.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.26.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.27.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.27.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.27.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.27.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.28.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.28.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.28.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.28.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.28.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.28.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.28.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.28.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.28.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.28.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.29.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.29.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.29.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.29.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.29.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.29.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.29.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.29.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.29.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.29.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.3.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.3.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.3.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.3.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.3.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.3.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.3.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.3.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.3.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.3.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.4.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.4.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.4.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.4.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.4.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.4.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.4.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.4.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.4.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.4.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.5.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.5.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.5.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.5.self_attn.v_proj.weight": "model.safetensors", | |
| "language_model.model.layers.6.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.6.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.6.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.6.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.6.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.6.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.6.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.6.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.6.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.6.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.7.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.7.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.7.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.7.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.7.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.7.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.7.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.7.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.7.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.7.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.8.conv.conv.weight": "model.safetensors", | |
| "language_model.model.layers.8.conv.in_proj.biases": "model.safetensors", | |
| "language_model.model.layers.8.conv.in_proj.scales": "model.safetensors", | |
| "language_model.model.layers.8.conv.in_proj.weight": "model.safetensors", | |
| "language_model.model.layers.8.conv.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.8.conv.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.8.conv.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.8.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.8.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.8.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w1.biases": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w1.scales": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w1.weight": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w2.biases": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w2.scales": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w2.weight": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w3.biases": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w3.scales": "model.safetensors", | |
| "language_model.model.layers.9.feed_forward.w3.weight": "model.safetensors", | |
| "language_model.model.layers.9.ffn_norm.weight": "model.safetensors", | |
| "language_model.model.layers.9.operator_norm.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.k_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.k_proj.biases": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.k_proj.scales": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.k_proj.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.out_proj.biases": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.out_proj.scales": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.out_proj.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.q_layernorm.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.q_proj.biases": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.q_proj.scales": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.q_proj.weight": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.v_proj.biases": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.v_proj.scales": "model.safetensors", | |
| "language_model.model.layers.9.self_attn.v_proj.weight": "model.safetensors" | |
| } | |
| } |