Gorilla4X/Quacken-8B-FP8
Text Generation • 8B • Updated • 248
RDNA4 (gfx1201) native-fp8, Quark-quantized. Source + container: github.com/The-Monk/The-Rock8 🦆 Got any weights?
Note Async spec-decode showcase: ternary Q2 self-draft, +66% byte-identical
Note Mixed FP4-MLP/FP8-attn: 23GB single-card, PPL 6.88, +30% decode vs fp8