Qwerky Optimized Hybrid Attention Experiments - a QwerkyAI Collection

QwerkyAI 's Collections

Qwerky Optimized Hybrid Attention Experiments

Qwerky Optimized Hybrid Attention Experiments

updated Dec 3, 2025

I can't believe it's not attention.

QwerkyAI/Qwerky-Optimized-Llama3.2-Mamba-0.2-3B-Instruct

Text Generation • 4B • Updated Nov 25, 2025 • 10 • 3
QwerkyAI/Qwerky-Optimized-Llama3.1-Mamba-0.2-8B-Instruct

Text Generation • 9B • Updated Dec 3, 2025 • 9 • 4