Anyone running this on 2×H200 with vLLM? Hangs after "Fp8 MoE backend"
1
#23 opened 16 days ago
by
Maclow
[Feature request] Eliminate pre-attention RMSNorm in Mistral-Small 4 via scale invariance + weight folding
#20 opened 2 months ago
by
graefics
Create Dockerfile
🤗🧠 1
#18 opened 4 months ago
by
sa6273473
When using in vibe or opencode, often responds with just "Task completed" instead of actually doing the task
🚀 1
3
#16 opened 4 months ago
by
sdroege
Love the license, confused by some of the decisions.
🤝👍 16
15
#15 opened 4 months ago
by
CyborgPaloma
Wrong context length in context?
1
#14 opened 4 months ago
by
wimmmm
Small?
👍🤝 16
6
#12 opened 4 months ago
by
Carnyzzle
Please state benchmark versions
👍 2
2
#11 opened 4 months ago
by
harveensingh-sarvam
please make a 15B and 40B creative writting model. ❤️❤️
1
#6 opened 4 months ago
by
UniversalLove333
"Small" model is now 120B and beyond the reach of most people, even in the upper-middle class with multiple consumer GPUs
❤️👍 15
68
#5 opened 4 months ago
by
Fizzarolli
Recommended sampler?
4
#4 opened 4 months ago
by
mratsim
Video of Step-by-Step Review and Testing
#3 opened 4 months ago
by
fahdmirzac
Add evaluation results
#2 opened 4 months ago
by
nielsr
French Hegemonia
🤗 2
1
#1 opened 4 months ago
by
ox-ox