lilm1-200m 16K recovery pilot

Controlled 299.63M-token continuation from the 2K/27B base checkpoint. The mixture is 34% document-contiguous 16K Longmino data and 66% 2K replay. This is an experimental base checkpoint and requires the custom model.py.

Downloads last month
160
Safetensors
Model size
0.3B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support