Startlux

company

https://x.com/StartLuxAI

AI & ML interests

None defined yet.

Recent Activity

Lie24 authored a paper about 10 hours ago

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

zunhai authored a paper about 18 hours ago

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

zunhai authored a paper about 18 hours ago

SnapMLA: Efficient Long-Context MLA Decoding via Hardware-Aware FP8 Quantized Pipelining

View all activity

Papers

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

View all Papers

startlux-models 's papers 1

Submitted by

zunhaisu

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

startlux-models