MoM: Linear Sequence Modeling with Mixture-of-Memories
Paper • 2502.13685 • Published • 36
Model of the paper MoM: Linear Sequence Modeling with Mixture-of-Memories.
The model was trained on a sample of SlimPajama with 100B tokens. We use Gated-Deltanet as the memory update mechanism.
- Downloads last month
- 6
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support