jeffasante's picture
Upload folder using huggingface_hub
3e258d0 verified
|
Raw
History Blame
1.02 kB

LFM2.5-350M (cellm)

Liquid Foundation Model 2.5 (350M) converted to cellm format. Pre-quantized to 4-bit using MLX.

Model details

  • Base model: liquid-ai/LFM2.5-350M-MLX-4bit
  • Format: cellm (.cellm)
  • Precision: 4-bit weights (MLX int4), f16 norms
  • Size: 211 MB
  • Architecture: 16 layers, hybrid LIV convolution + grouped-query attention
    • Pattern: conv, conv, attn, conv, conv, attn, conv, conv, attn, conv, attn, conv, attn, conv, attn, conv
  • Hidden size: 1024
  • Vocab: 65,536

Usage

./target/release/infer \
  --model lfm2.5-350m-v1.cellm \
  --tokenizer tokenizer.json \
  --prompt "The capital of France is" \
  --gen 40 --temperature 0 --backend cpu --kv-encoding f16

Notes

  • Text completion only. This is a base model.
  • 350M parameters at 4-bit gives 211 MB on disk.
  • The LIV (Linear Input-Varying) conv blocks use a causal sliding-window state per layer.
  • Use temperature > 0 for more varied output.

License

Apache 2.0 (same as upstream LFM2.5)